Great Expectations Framework

From GM-RKB
Jump to navigation Jump to search

A Great Expectations Framework is a data quality framework ...



References

2023

  • https://docs.greatexpectations.io/docs/
    • QUOTE: Great Expectations is the leading tool for validating, documenting, and profiling your data to maintain quality and improve communication between teams. If you're ready to get started, see the Quickstart.

      Software developers have long known that automated testing is essential for managing complex codebases. Great Expectations brings the same discipline, confidence, and acceleration to data science and data engineering teams.

    • With Great Expectations, you can assert what you expect from the data you load and transform, and catch data issues quickly – Expectations are basically unit tests for your data. Not only that, but Great Expectations also creates data documentation and data quality reports from those Expectations. Data science and data engineering teams use Great Expectations to:
      • Test data they ingest from other teams or vendors and ensure its validity.
      • Validate data they transform as a step in their data pipeline in order to ensure the correctness of transformations.
      • Prevent data quality issues from slipping into data products.
      • Streamline knowledge capture from subject-matter experts and make implicit knowledge explicit.
      • Develop rich, shared documentation of their data.