truera/trulens: TruLens-Eval v0.32.0

What's Changed Context filtering guardrails by @sfc-gh-jreini in https://github.com/truera/trulens/pull/1192 Query optimizations for TruLens dashboard resulting in 4-32x benchmarked speedups by @sfc-gh-chu in https://github.com/truera/trulens/pull/1216 Logging in Snowflake database by @sfc-gh-c...

Full description

Bibliographic Details
Main Authors: Josh Reini, Piotr Mardziel, rshih32, shayaks, Klas Leino, corey hu, Daniel, Garett Tok Ern Liang, Aaron, Daniel Huang, Divya Gopinath, Anupam, Lariel Fernandes, DavidKurokawa, Jisoo, Nicolò Boschi, Ingrid Stevens, Eric Pinzur, Noah van der Vleuten, Marie-Philippe Gill, Nacho Villaluenga, Nikhil Vytla, Paul Stoker, Sayed Sohan, Sebastian Schmidt
Format: Other/Unknown Material
Language:unknown
Published: Zenodo 2024
Subjects:
Online Access:https://doi.org/10.5281/zenodo.12520679
Description
Summary:What's Changed Context filtering guardrails by @sfc-gh-jreini in https://github.com/truera/trulens/pull/1192 Query optimizations for TruLens dashboard resulting in 4-32x benchmarked speedups by @sfc-gh-chu in https://github.com/truera/trulens/pull/1216 Logging in Snowflake database by @sfc-gh-chu in https://github.com/truera/trulens/pull/1216 Snowflake Cortex feedback provider by @sfc-gh-dhuang in https://github.com/truera/trulens/pull/1202 improve langchain prompting using native messages by @nicoloboschi in https://github.com/truera/trulens/pull/1194 fix groundedness with no supporting evidence by @nicoloboschi in https://github.com/truera/trulens/pull/1193 Improve Microsecond support by @sfc-gh-gtokernliang in https://github.com/truera/trulens/pull/1195 SkipEval exception by @sfc-gh-pmardziel in https://github.com/truera/trulens/pull/1200 Update pull_request_template.md by @sfc-gh-jreini in https://github.com/truera/trulens/pull/1234 Use rounding instead of flooring in feedback score extraction by @sfc-gh-dhuang in https://github.com/truera/trulens/pull/1244 Documentation Benchmarking Snowflake arctic-instruct feedback function of groundedness by @sfc-gh-dhuang in https://github.com/truera/trulens/pull/1185 Evaluation Benchmarks Page by @sfc-gh-jreini in https://github.com/truera/trulens/pull/1190 Documentation for snowflake sqlalchemy implementation by @sfc-gh-chu in https://github.com/truera/trulens/pull/1216* Documentation for logging in snowflake database by @sfc-gh-chu in https://github.com/truera/trulens/pull/1216 Documentation for cortex provider by @sfc-gh-dhuang in https://github.com/truera/trulens/pull/1202 Examples Context filtering guardrails added to quickstarts by @sfc-gh-jreini in https://github.com/truera/trulens/pull/1192 Update Arctic model notebook to use new Cortex provider by @sfc-gh-dhuang in https://github.com/truera/trulens/pull/1202 New example showing cortex finetuning by @sfc-gh-dhuang in https://github.com/truera/trulens/pull/1202 show how to add cost/latency/usage details in ...