Data governance and access control

Connect ownership, permissions, lineage and change control throughout the analytical lifecycle.

Governance becomes practical when a team can answer four questions about a result: who owns it, what it means, who may use it and how it was produced. Those answers should remain available as data moves between systems, analytical models and shared investigations.

The following controls support Covorg’s emphasis on traceable analysis and collaboration. They are questions for solution design and evaluation, not claims of certification or a universal compliance framework. The appropriate controls depend on the information involved and the organisation’s obligations.

Assign responsibility at a useful level

A dataset owner should be able to explain purpose, source authority, quality expectations and permitted use. A metric owner should approve the calculation and its business interpretation. These responsibilities may belong to different people, particularly when several business functions consume the same source.

Record a steward for day to day issues and an approver for material changes. Ownership that exists only in a project handover document becomes difficult to maintain. Keep the relevant responsibilities close to the dataset or metric so users can find the right person during an investigation.

Evaluate access at the point of use

OWASP recommends minimum necessary privileges, default denial and permission validation on every request. Applied to analytical work, this means access must account for the resource and the requested operation. Permission to read an aggregate dashboard does not automatically imply permission to export its underlying records.

ResourceExample permission questionDesign consideration
DatasetWhich business unit may view these rows?Apply the relevant organisational scope
Sensitive fieldIs an identity value needed for the task?Minimise disclosure and derived copies
MetricMay this user see the underlying detail?Separate aggregate and record access
ReportMay the recipient export or redistribute it?Review destination and retention
InvestigationDoes a comment reveal restricted information?Protect attachments and discussion context
Governance responsibilities extend to source access, transformations, analytical services and published information.

Connect lineage with activity history

Lineage explains the relationship between inputs, transformations and outputs. Activity history explains who changed a definition, approved a report or assigned an action. Keeping both makes it possible to distinguish a source correction from a changed calculation or a different user interpretation.

The OpenLineage object model separates jobs from individual runs. This distinction is helpful when a transformation has succeeded many times but one run used an incomplete source partition. A useful investigation should connect the affected result to that specific execution and its recorded inputs.

Treat definitions as managed changes

Changing a metric can affect reports, alerts and historical comparisons. A proposed revision should identify its reason, effective date, dependent assets and approval owner. Compare the previous and proposed outputs on representative periods before publishing a change that alters business interpretation.

Retention and deletion policies must also follow derived information. Removing a source record does not automatically remove exports, cached results or attachments. Map these copies during design, define the applicable responsibilities and verify that access revocation reaches the places where information is actually consumed.

Example metric definition change

  1. 01

    Propose

    Document a revised treatment of cancelled orders and its business rationale.

  2. 02

    Assess

    Locate dependent reports, alerts and historical comparisons.

  3. 03

    Approve

    Review comparative results with the metric owner and affected teams.

  4. 04

    Publish

    Release a versioned definition with an effective date and change history.

Design considerations

  • Include exports, scheduled reports and shared attachments in access reviews.
  • Document retention requirements for both source data and derived analytical outputs.
  • Revisit privileges when people change responsibilities or leave an organisation.

Sources

The following sources explain the underlying technical patterns.

  1. OWASPAuthorization guidanceOpens in a new tab
  2. OpenLineageThe OpenLineage object modelOpens in a new tab
  3. dbt LabsThe dbt Semantic LayerOpens in a new tab

Image details

100%

Zoom in to inspect details