πŸ” Search
Sign in to post
Show HN: Open-source edge data governance libraryhttps://www.csvpath.org

CsvPath Framework is a Python data firewall that protects downstream systems from bad data getting past the ingress point. Data is much easier to fix when you shift quality control left, remove manual data checking, stop accumulating orphaned ingestion code, and decrease the skills consumed by data pipelines. The Framework: - registers inbound data into an immutable, versioned staging area, with a cryptographic identity, - validates and upgrades it using one or more of five validation languages, - generates ops and lineage metadata for OpenLineage and OpenTelemetry, - and publishes results da…

β†—

0trust.social media

Loading your media...

Pick a GIF β€” Giphy

Loading GIFs...