Traditional measures evaluating the success of online academic advising can take a significant amount of time to gather. Using a scorecard approach, with regular monitoring of student contacts and interactions for quality and quantity, can provide timelier evidence of good online academic advising and identify possible opportunities for retraining and coaching.