Pros
The convienence and flexibility are the biggest "pros" when working for this company. There were many times when I've cancelled shifts last minute without any consequences. The pay is reasonable for what the job requires of you. Granted, everyone working is very educated, but this job isn't meant to serve as full time employment with benefits and shouldn't be treated as such.
Cons
Depending on the testing program you're scoring for, some only run a few weeks out of the year. Sometimes they over-hire people and so it makes it difficult to get shifts. Instead of hiring new folks, they should just offer cross-training of different programs for current employees/raters. I really have no issues working here aside from the severe lack of shifts/hours. If I can average even 15-20 hours a week, every week, I would be ecstatic.