UPSCR Grading Update

We evaluated sessions to determine which students were consistently misaligned to the UPSCR process across all tutors. The following students will have their UPSCR scores and student ratings removed from metrics for the month of June. Their sessions will still show up in your workbook and will count towards the number of graded sessions. 

Students

We removed the scores associated with 14 students. They are students who frequently appeared in our Student Feedback Slack Channel. We have decided to keep the names anonymous. We appreciate understanding on this point.

June Bonus Update

After a re-evaluation of June scores, we’ve updated our bonus metrics to the following. As a reminder, student ratings will not impact bonuses in June.

Tutor Bonus

  • Level 1: 10 graded sessions, 6.5 UPSCR score (no change)
  • Level 2: 15 graded sessions, 7 UPSCR score (-0.5 UPSCR score)

TQM Bonus

  • Level 1: 10 graded sessions, 7 UPSCR score (-0.5 UPSCR score)
  • Level 2: 15 graded sessions, 7.5 UPSCR score (-0.5 UPSCR score)

We will continue to monitor these metrics before making any permanent changes. 

We may have to make similar adjustments for overall TGP metrics, but we will wait to do so until we have a fully aggregated data set in August. 

Thank you and as always please email tutor.support@yup.com with any questions.

Quick Updates and Thank You!

Hi all! We want to use this Newsfeed post for a quick reminder of some important items and then a big Thank You! to all of our tutors.

Announcements / Reminders

  • We’re moving to a grading system that allows for nulls on each UPSCR strand. Sharon is already prepping training materials for how to identify misaligned students and our engineering team is readying to work on this item.
  • For June and July, we’ll identify our most misaligned students and dispute their scores. June UPSCR average is already ~5.6!
  • For June, we’ll be ignoring student ratings in our metrics.
  • Our schools pilot ends today. We had 28 students use our service for ~300 sessions over two weeks! These are Summer school students from historically disadvantaged backgrounds and they loved working with you!

From the schools pilot teacher: These students are the ones who were struggling to pass in the first place. I didn’t think that these students cared, and they were visibly excited in class. It was awesome. I looked at transcripts and students were learning. They were being pushed to think. Students complained about the amount of questions, but I told them “this is learning” 

Thank You!!!

It’s been a hectic few months at Yup and in the world and we want to take a step back and thank all of you for your fantastic work. We’ll continue to rely on your feedback to make our product and our team better. 

Our students appreciate you too! Here are a sampling of quotes from our students thanking Yup tutors for all that you do.

“You have helped me so much and I hope you can help others perfectly as you did with me!!”

“Thank you so much for all your help & guidance!! I appreciated the amount of resources you provided me with, such as new formulas & old ones that I forgot. Thanks for your time :)”

“Thank you for helping me understand my work and have a clearer understanding of my math!”

Amazing as always! thanks a lot and hope to see you soon on Yup again! 

Thanks, Thanks, Thanks, Thanks, Thanks, Thanks, Thanks, Thanks

(yes the student typed it this many times) 

Thank you so much for helping me & being so patient!! You made visuals & color coded them to make them significantly more understandable, which I appreciated a lot. Thank you for your time 🙂

Really cool, and sent me a challenging question. It might’ve been simple for me but I’m glad we did a lot of things!

New UPSCR Grading Update

In a recent Slack post, the Yup Academics team asked tutors for input on making sure our grading system fairly and effectively judges tutor performance in a session. 

As a result of this input, as well as evaluation of sessions with misaligned students, we’re excited to announce a few changes to how we’ll grade.

Long Term

We are pursuing the solution recommended by many tutors of introducing nulls to scoring when a student stops engaging. We anticipate this may take ~1 month to implement due to the number of steps involved:

  • Engineering updates
  • Tutor scores tracking system updates
  • Tutor workbook updates
  • TQMs training for consistency in applying nulls

Short Term

We want to ensure that tutors are fairly judged for their performance this past month in a way that is sustainable for the Academics team to implement. As such, we have decided that at the end of the month, Academics will do the following:

  • Review sessions of the lowest scoring students 
  • Review sessions of the most disengaged students
  • Create a list of students who have not followed UPSCR and remove their scores

We will release this list in the beginning of July for transparency.

Please let us know if you have any questions by reaching out to tutor.support@yup.com and Happy Tutoring!

Update & May Outstanding Student Feedback Winner

Update on UPSCR Data Systems Rollout

Unfortunately, we need to push back rollout of our new tutor workbooks and other data systems until June 15. We understand this is not ideal and apologize. If you have any questions, please reach out to tutor.support@yup.com

Student Feedback

Congratulations to Christine Quinter for earning the Outstanding Student Feedback Award! This award is given to tutors who receive consistent, outstanding written feedback from students over several weeks along with demonstrating excellent overall performance.

Some of Christine’s exceptional student feedback comments include:

  • “Amazing and I felt like I was there learning with her in a room”
  • “Ms. Quinter was extremely helpful, and an excellent tutor. I had a lot of work to complete today and she had a great attitude and a lot of patience the entire time. I would love to work with her again!”
  • “Thank you so much! The way that you explained this made so much more sense than my textbook.”
  • “She helped me realize my mistake on why I kept getting the wrong answer”
  • “Wow! That was fun! Thanks!”

Way to go Christine!

Announcing TGP Updates With UPSCR

Hi Yup Tutors. With the planned 6/1 launch of UPSCR, we want to provide information on upcoming changes. The below are policy outlines. We aim to provide new UPSCR cutoffs on 5/31. These will be based on scores the week of 5/25, so don’t worry if your scores look different! We may also update cutoffs based on performance.

All changes are planned to take effect on 6/1, but as always, launch dates and decisions are subject to change, and we’ll keep you updated.

Evaluative System Changes

Introducing Professionalism Metrics

These are base expectations for tutoring on our platform. >95% tutors consistently achieve these metrics. Not meeting these metrics on a monthly basis will result in contract re-evaluation. We will not hold tutors accountable for bug-related issues.

Metric Threshold
Attendance 90%
Claim Rate 85%
Student Ratings 80%
Wrong Answer / Insufficient Content Knowledge Tags <10%

TGP Updates

Student ratings no longer affect TGP Level. Instead, we focus on UPSCR and total sessions. Falling below L2 metrics at end of cycle will result in contract re-evaluation. 

Result Requirement Reward
Level Name All Time Sessions Previous Cycle Score Rate Increase Max Schedule
Hrs/Week
Max Shift
Hrs/Week
5 Quality Manager
(must apply)
500 TBC 22.5% 40 60
4 Master Yup Tutor 300 TBC 15% 40 50
3 Distin-guished Yup Tutor 100 TBC 7.5% 25 40
2 Yup Tutor 25 TBC 0% 10 25
1 New Yup Tutor 0 N/A 0% 0 10

Bonus Updates

Bonuses will now reflect UPSCR scores and the number of graded sessions in a month. Additionally, all professionalism metrics must be satisfied for the month.

Result Requirement Reward
Tier Description Graded Sessions Monthly Score Rate Increase
2 Exemplary 15 TBC 10%
1 Strong 10 TBC 5%

Please note that we have updated bonuses from being “multipliers” to rate increases. This will impact <1% of tutor pay and simplify the TGP system.

Other Policy Changes

Removing Disputes

Our UPSCR grading audits have shown that TQMs are scoring sessions with extreme similarity and accuracy. Furthermore, our most common dispute requests – removing wrong answer tags – no longer impacts TGP scores as critically. Based on this, we’ve decided to remove our session dispute policy.

Session Feedbacking

Some tutors have had only 33% of sessions feedbacked over the last month. For the Summer, all tutors will have 100% of sessions feedbacked. 

Please bring any questions you have about these changes to the slidos of your respective trainings!