UPSCR Grading and Student Feedback Policy Updates

As promised, we have fleshed out our plans for grading policy changes over near- and long-term. Here are the upcoming changes:

Immediate Policy Updates

Remove the student feedback channel

  • Tracking students individually is a manual and unscalable task
  • The channel has shifted away from its purpose of providing tips on how to work with students and towards understandable, but ultimately unproductive, venting; we would like Yup tutors to enter each session on a “blank slate” with students
  • As we move to school focus, we will explore other forms of feedback
  • You are still welcome to message Henry/Sharon individually about major concerns with student behavior

Continue removing scores from misaligned students

  • As in June, we intend to remove scores from misaligned students based on internal investigation for July; this has the most impact without undue manual/engineering work

Near Term Policy Updates

Formalize TQM ability to nullify a session

  • We will be changing the first question from “Did the tutor ask instructional questions?” to “Was student engagement reasonably within the tutor’s control?” at the start of each session feedback; TQMs may select “No” and nullify the session
  • TQMs will undergo training and norming process to ensure grading is fair; however, we will continue to not allow disputes

Long Term Policy Updates

Engineering to add nulls by strand feature

  • In the coming months, we will introduce a feature to allow TQMs to score certain strands and not others based on student engagement

Yup Resource Spotlight

We’ve had a number of requests regarding how we onboard teachers and students and introduce UPSCR. We’ll be releasing materials weekly so that you can see how your hard work is translated in the classroom!

For week one, check out our Pitch Deck: what we go through with schools during introductory calls!

Vacation

And finally, the Yup HQ team will be taking some hard earned vacation!

  • Henry: 7/20-7/24 (shift auditing may be delayed, no newsfeed post)
  • Sharon: 7/27-7/31
  • Kreg: 7/23-7/24

UPSCR Grading Update

We evaluated sessions to determine which students were consistently misaligned to the UPSCR process across all tutors. The following students will have their UPSCR scores and student ratings removed from metrics for the month of June. Their sessions will still show up in your workbook and will count towards the number of graded sessions. 

Students

We removed the scores associated with 14 students. They are students who frequently appeared in our Student Feedback Slack Channel. We have decided to keep the names anonymous. We appreciate understanding on this point.

June Bonus Update

After a re-evaluation of June scores, we’ve updated our bonus metrics to the following. As a reminder, student ratings will not impact bonuses in June.

Tutor Bonus

  • Level 1: 10 graded sessions, 6.5 UPSCR score (no change)
  • Level 2: 15 graded sessions, 7 UPSCR score (-0.5 UPSCR score)

TQM Bonus

  • Level 1: 10 graded sessions, 7 UPSCR score (-0.5 UPSCR score)
  • Level 2: 15 graded sessions, 7.5 UPSCR score (-0.5 UPSCR score)

We will continue to monitor these metrics before making any permanent changes. 

We may have to make similar adjustments for overall TGP metrics, but we will wait to do so until we have a fully aggregated data set in August. 

Thank you and as always please email tutor.support@yup.com with any questions.

Quick Updates and Thank You!

Hi all! We want to use this Newsfeed post for a quick reminder of some important items and then a big Thank You! to all of our tutors.

Announcements / Reminders

  • We’re moving to a grading system that allows for nulls on each UPSCR strand. Sharon is already prepping training materials for how to identify misaligned students and our engineering team is readying to work on this item.
  • For June and July, we’ll identify our most misaligned students and dispute their scores. June UPSCR average is already ~5.6!
  • For June, we’ll be ignoring student ratings in our metrics.
  • Our schools pilot ends today. We had 28 students use our service for ~300 sessions over two weeks! These are Summer school students from historically disadvantaged backgrounds and they loved working with you!

From the schools pilot teacher: These students are the ones who were struggling to pass in the first place. I didn’t think that these students cared, and they were visibly excited in class. It was awesome. I looked at transcripts and students were learning. They were being pushed to think. Students complained about the amount of questions, but I told them “this is learning” 

Thank You!!!

It’s been a hectic few months at Yup and in the world and we want to take a step back and thank all of you for your fantastic work. We’ll continue to rely on your feedback to make our product and our team better. 

Our students appreciate you too! Here are a sampling of quotes from our students thanking Yup tutors for all that you do.

“You have helped me so much and I hope you can help others perfectly as you did with me!!”

“Thank you so much for all your help & guidance!! I appreciated the amount of resources you provided me with, such as new formulas & old ones that I forgot. Thanks for your time :)”

“Thank you for helping me understand my work and have a clearer understanding of my math!”

Amazing as always! thanks a lot and hope to see you soon on Yup again! 

Thanks, Thanks, Thanks, Thanks, Thanks, Thanks, Thanks, Thanks

(yes the student typed it this many times) 

Thank you so much for helping me & being so patient!! You made visuals & color coded them to make them significantly more understandable, which I appreciated a lot. Thank you for your time 🙂

Really cool, and sent me a challenging question. It might’ve been simple for me but I’m glad we did a lot of things!

New UPSCR Grading Update

In a recent Slack post, the Yup Academics team asked tutors for input on making sure our grading system fairly and effectively judges tutor performance in a session. 

As a result of this input, as well as evaluation of sessions with misaligned students, we’re excited to announce a few changes to how we’ll grade.

Long Term

We are pursuing the solution recommended by many tutors of introducing nulls to scoring when a student stops engaging. We anticipate this may take ~1 month to implement due to the number of steps involved:

  • Engineering updates
  • Tutor scores tracking system updates
  • Tutor workbook updates
  • TQMs training for consistency in applying nulls

Short Term

We want to ensure that tutors are fairly judged for their performance this past month in a way that is sustainable for the Academics team to implement. As such, we have decided that at the end of the month, Academics will do the following:

  • Review sessions of the lowest scoring students 
  • Review sessions of the most disengaged students
  • Create a list of students who have not followed UPSCR and remove their scores

We will release this list in the beginning of July for transparency.

Please let us know if you have any questions by reaching out to tutor.support@yup.com and Happy Tutoring!

Update & May Outstanding Student Feedback Winner

Update on UPSCR Data Systems Rollout

Unfortunately, we need to push back rollout of our new tutor workbooks and other data systems until June 15. We understand this is not ideal and apologize. If you have any questions, please reach out to tutor.support@yup.com

Student Feedback

Congratulations to Christine Quinter for earning the Outstanding Student Feedback Award! This award is given to tutors who receive consistent, outstanding written feedback from students over several weeks along with demonstrating excellent overall performance.

Some of Christine’s exceptional student feedback comments include:

  • “Amazing and I felt like I was there learning with her in a room”
  • “Ms. Quinter was extremely helpful, and an excellent tutor. I had a lot of work to complete today and she had a great attitude and a lot of patience the entire time. I would love to work with her again!”
  • “Thank you so much! The way that you explained this made so much more sense than my textbook.”
  • “She helped me realize my mistake on why I kept getting the wrong answer”
  • “Wow! That was fun! Thanks!”

Way to go Christine!