The Tasker will have the ability to enter text, which can be made public or kept private. You can choose not to share the comments.
If the comments are inappropriate, you will have the option to Report the abuse by pressing the 'Report' button.
The ratings are an overall average, so one rating that does not seem consistent with the majority of your tasks should not harm your overall rating.