3 Comments
User's avatar
Mark Johnson's avatar

Hey Aman, thanks for running the session and writing this up!

I don't see the Evaluators button at the top right for step 5. Do you have any suggestions?

Also, when creating the eval, it seems to require a project? Is it possible to run the eval against the uploaded dataset without sending traces to Arize?

Expand full comment
Aman Khan's avatar

Hey Mark! Thanks for the feedback - this is fixed now! We had too much traffic after the session and had to make a few changes, so my engineering team temporarily hid the feature. Would love your feedback now that it's live again!

Expand full comment
Mark Johnson's avatar

Thanks Aman! It's working as expected now and I can see the friendly/unfriendly eval results for the travel agent example responses. Looking forward to playing around with this with my own data. Thanks for following up!

Expand full comment