1. What is the tester score?
Rainforest continuously evaluates testers’ performance and maintains a score for each tester. The tester score affects the following:
- The probability of receiving a job - higher score means higher probability of receiving an available job.
- Note - the total number of jobs you receive would depend on multiple factors such as your score, the number of available testers and their scores, and the schedule in which the jobs are being initiated by our customers.
- The type of jobs tester receives - testers with higher score may be assigned with unique jobs that are paid more.
- Payment provider fee - Rainforest will waive your Paypal fee if your score level is 'A' during cashout. Note - the only score that matters for the decision whether to waive your Paypal fee or not is the score during cashout. Your score while performing the job/s doesn't influence the waiving decision.
2. What is the tester score level?
The tester score is clustered into a score level as follows:
- Score level A: tester score from 90 to 100
- Score level B: tester score from 80 to 89
- Score level C: tester score from 70 to 79
- Score level D: tester score from 60 to 69
- Score level E: tester score from 0 to 59
Your score level can be found in your portal profile and in the Reviews page.
3. How does Rainforest calculate the tester score?
The tester score consists of multiple factors. One of the main factors is the manual job reviews which are now shared with you in the tester portal (under “Reviews”). In general - the more approved reviews you get, the higher your score level would be, and the more rejected reviews you get, the lower your score level would be. That being said, you might notice situations that contradict the above. For example - you might notice that your score level changes without receiving new reviews. Another example - you might notice that your score level doesn’t change even though you receive approved reviews or rejected reviews. This is perfectly normal as there are other factors that influence the score which are not visible to you (to avoid potential abuse).
4. What is the “Reviews” page?
We manually review your jobs to determine whether the jobs were performed correctly. In the Reviews page you can see your reviewed jobs since 1.1.2018. The Reviews page includes a table in which each row represents a single manually reviewed job. For each reviewed job you can see the decision that was made by the reviewer (approved or rejected), a comment from the reviewer (when applicable), a link to the reviewed job and the option to take action (explained below).
5. What is the “remaining disputes” in the Reviews page?
How it works:
- You start out with 3 disputes at the beginning of each calendar month
- A review is “disputable” if the review was
rejectedAND it was created within the past 7 days AND if you have disputes left you can use.
- Once you dispute a job review, you have 2 remaining disputes to use and 1 pending.
- If the pending dispute is approved (i.e. you are right), you get one dispute back, and will see 3 remaining disputes.
- If the dispute is rejected (i.e. your 2nd reviewer disagrees with your provided reason), you lose 1 dispute, and are left with 2 remaining disputes to use.
Note: Only disputes from the current calendar month count towards your remaining disputes for that month (e.g. if you disputed a job in June, but a decision wasn’t made until July, your July dispute count won’t be affected). However, your tester score will still be positively impacted if your dispute is approved, even if it’s from a previous month.
6. How to view the details of a reviewed job?
If you want to view in detail a specific job that was reviewed by us, you can click on a job ID link from the reviewed jobs table. Once you click on one of the links, you’ll be sent to the tester jobs page which includes information about the job such as the step instructions, screenshots, video, and comments that were posted by you, and the reviewer (when applicable).
This will allow you to better understand how the reviewer reached the decision to approve or reject your job.
7. What are the different Action options in the job reviews table?
The Action column from the job reviews table can contain one of the following:
- “Not disputable” - if the job was approved or if the job was rejected more than 7 days ago
- “Dispute” - the option to dispute if the job was rejected within the last 7 days.
- “Rejected” - your dispute was rejected
- “Accepted” - your dispute was accepted
8. Can I dispute a reviewed job?
You can only dispute a job that was rejected and it has to be within 7 days of receiving the rejection. After 7 days, rejected jobs cannot be disputed anymore. You should submit a dispute only if you are convinced that you received an unjustified rejection. If your job was rejected for multiple reasons (multiple mistakes), and you agree with at least one of them (but disagree with the rest) you should NOT submit a dispute for this job (your dispute will be rejected if the job includes even a single mistake).
9. How can I dispute a job from the job reviews table?
- Click on the “Dispute” button.
- You’ll be prompted to add a comment - please explain in detail why you believe your dispute should be accepted.
- Submit your dispute.
10. Why can’t I dispute some of my rejected jobs?
Rejected jobs that were reviewed more than 7 days ago cannot be disputed anymore (they change from “Dispute” to “Not disputable” after 7 days from being reviewed). The date column in the job reviews table indicates when the job was reviewed.
11. My dispute was rejected. Is there a way to dispute it again as I’m sure I did everything correctly?
No. The dispute decision is final and you cannot dispute a review more than once.
12. What is the “Rejected training jobs” page?
Training job rejections do not affect your tester score. The “Rejected training jobs” page is replacing the legacy “Rejections” page and it includes only rejections from your training jobs. The other types of rejections that Rainforest used to share with you (such as the simple calculation questions, and others) will no longer be available in an effort to reduce confusion and since these types of rejections will not affect your score.
13. Is there a limit to the number of jobs I can receive based on my score level?
No. Rainforest doesn’t limit the number of jobs you can receive based on your score level. Your score level will determine the probability of receiving a job, taking into consideration other factors such as other testers’ availability and their score, and the available jobs at a given time.
14. Will I get blocked if I receive many rejections?
If you receive 10 consecutive training job rejections (i.e. 10 in a row), you will be automatically blocked from using your Rainforest account.
You may also be blocked at any time at an admin's discretion, usually due to poor performance or behavior that goes against our Code of Conduct. For more information, see our Block Policy.
15. How to increase my score effectively so I can get more jobs?
Rainforest recommends that you read carefully the tester rules, the supporting examples, and review all your rejected jobs. As you perform jobs make sure to follow the rules, follow the test author instructions, and provide polite suggested improvements and failure reports. As long as you follow these guidelines, you’ll receive more approvals and your score will increase overtime.
16. When will my dispute be processed?
Please expect up to two weeks.
17. Why do other testers with lower score level receive more jobs than I do?
The number of jobs you receive would depend on multiple factors such as your score, the number of available testers and their scores, and the schedule in which the jobs are being initiated by our customers. Given 2 testers that are available at the same time of the day - one of them has an A-score while the other has a C-score - the tester with an A-score will most likely receive more jobs than the tester with the C-score.
18. Will I receive any notification when I receive a new rejection?
No. Please monitor your “Reviews” page at least once a week to make sure you notice new rejections within 7 days of receiving them.
19. How do the dispute decisions affect my score?
If your dispute was accepted - we will consider this job as any other approved review (even though it was originally rejected). If your dispute was rejected - we will consider this job as any other rejected review.
20. How do I dispute training job rejections?
Training job rejections can still be disputed by submitting a support ticket via the "Help" tab in your portal profile. Training job rejections do not affect your tester score.
Reminder: Regular job rejections must be disputed via the "Reviews" tab. If you dispute a regular job rejection via the "Help" tab or Rainforest forum, your ticket will be immediately closed without further review.
21. Will I receive any additional feedback after submitting a dispute?
Yes! You’ll now receive comments from the 2nd reviewer to explain why your dispute was accepted or rejected. You’ll find that listed in the “Comment” column to the right of the “2nd reviewer’s decision” column. The decision made by the 2nd reviewer is considered final and you will not be able to dispute their decision through the portal or help desk ticket, should they reject your dispute.
We are rolling this feature out to testers in small batches, so you may not see this just yet on your Reviews page, but it will arrive soon!
22. Am I allowed to click on links Reviewers provide in their comments?
Yes. Reviewers may leave links to helpful resources in their review comments from time to time. It is okay for you to open these links with caution - reviewers are required to ensure the website they are linking to is safe before sharing it. However, you should always take the appropriate measures to make sure the website you are visiting is safe.
If you ever encounter a suspicious website when clicking on a link provided in a review comment (e.g. you are brought to a page that asks for personal information or login credentials), please exit the website immediately and report the comment to Rainforest Support via the “Help” tab. Please use the category “Other” and let us know that you encountered a suspicious website when opening a link provided in your review comment. For some general tips on website safety, you can check out this website https://www.avg.com/en/signal/website-safety