Hey Aman, thanks for running the session and writing this up!
I don't see the Evaluators button at the top right for step 5. Do you have any suggestions?
Also, when creating the eval, it seems to require a project? Is it possible to run the eval against the uploaded dataset without sending traces to Arize?
Hey Mark! Thanks for the feedback - this is fixed now! We had too much traffic after the session and had to make a few changes, so my engineering team temporarily hid the feature. Would love your feedback now that it's live again!
Thanks Aman! It's working as expected now and I can see the friendly/unfriendly eval results for the travel agent example responses. Looking forward to playing around with this with my own data. Thanks for following up!
Hey Aman, thanks for running the session and writing this up!
I don't see the Evaluators button at the top right for step 5. Do you have any suggestions?
Also, when creating the eval, it seems to require a project? Is it possible to run the eval against the uploaded dataset without sending traces to Arize?
Hey Mark! Thanks for the feedback - this is fixed now! We had too much traffic after the session and had to make a few changes, so my engineering team temporarily hid the feature. Would love your feedback now that it's live again!
Thanks Aman! It's working as expected now and I can see the friendly/unfriendly eval results for the travel agent example responses. Looking forward to playing around with this with my own data. Thanks for following up!
++ Good Post, Also, start here Compilation of 100+ Most Asked System Design, ML System Design Case Studies and LLM System Design
https://open.substack.com/pub/naina0405/p/important-compilation-of-most-asked?r=14q3sp&utm_campaign=post&utm_medium=web&showWelcomeOnShare=false