Round-Trip Correctness: A New Metric for Generative AI-Based Process Modeling community.sap.com 2 points by rramadass 1 month ago
rramadass 1 month ago Also see;Unsupervised Evaluation of Code LLMs with Round-Trip Correctness - https://arxiv.org/abs/2402.08699Code repository for the above - https://github.com/google-deepmind/icml2024-roundtrip-correc...RTCE: RoundTrip Code Evaluation Framework - https://www.emergentmind.com/topics/roundtripcodeeval-rtce
Also see;
Unsupervised Evaluation of Code LLMs with Round-Trip Correctness - https://arxiv.org/abs/2402.08699
Code repository for the above - https://github.com/google-deepmind/icml2024-roundtrip-correc...
RTCE: RoundTrip Code Evaluation Framework - https://www.emergentmind.com/topics/roundtripcodeeval-rtce