Governance
Please note that this content is under development and is not ready for implementation. This status message will be updated as content development progresses.
A high quality governance framework provides implementers with confidence that AATP
- is a public good that cannot be captured by any specific commercial interest and is free to use without license constraints
- is developed via a consensus based process that ensures it will meet the needs of the Australian Agriculture sector
- is specific, testable, and rigorously versioned so that implementers can be confident of stability and interoperability
- is compatible with relevant national and international standards and regulations.
The governance framework described on this page is designed to meet these criteria.
Governance Structure
The AATP is governed under the Australian Agricultural Traceability Governance Group (AATTG) within the Data Interoperability Governance Group (DIGG). To ensure that AATG achieves it's purpose, formal liaison with other AATTG groups is required.
- The Strategic Reference Group (SRG) to ensure that AATP continues to meet expectations and aligns with overall AATTG strategy.
- The Assuring Sustainability Claims Working Group (ASCWG) to ensure that AATP conformity claims and credentials meet integrity and conformance requirements.
- The Research and Development Working Group (R&DWG) to ensure that AATP continues to apply best practice technical standards and norms.
The AATP secretariat services, like the DIGG secretariat, are provided by the Food Agility CRC.
The AATP recognises that different agricultural sectors will have different requirements for commodity specific data. The bovine characteristics of cattle are of course very different to the product characteristics of grain. Nevertheless there are many common core data elements that can be re-used by each sector. Accordingly AATP defines a common re-usable core (aatp-core) as well as sector specific credentials such as a digital livestock passport. Furthermore, it is important to facilitate agility for sector specific specifications as well as stability for core components. For this reason AATP is governed at two layers that work at different pace.
- Sector specific teams with appropriate industry representation can develop and maintain their sector specific AATP extensions without constraint so long as the extensions apply the AATP extensions methodology and thereby retain cross-sector interoperability.
- From time to time, new common cross-sector needs will be identified that will require an extension to the aatp core standards. These changes are governed by the DIGG and released less frequently.
Membership of the sector specific development teams is determined by the industry associations that are voting members of the sector specific stewards. The sector specific stewards are, in turn appointed by the DIGG under AATTG national rules.
Like any other working group, change is agreed by consensus. Ideally consensus is unanimous within a team but, when there are dissenting votes, a simple majority vote applies.
Data Governance Scope
AATP is an extension of UNTP which is itself built on the W3C Verifiable Credentials Data Model (VCDM). Each of these layers define data models and a vocabulary that is protected. This means that UNTP must re-use and not re-define VCDM data elements such as "issuer" (party) and "validFrom" (date). UNTP in turn defines a suite of credential types such as a Digital Product Passport (DPP), Digital Conformity Credential (DCC), Digital Traceability Event (DTE) and Digital Facility Record (DFR) that are all represented as W3C Verifiable Credentials. UNTP is built using data elements defined by UN/CEFACT, Schema.org, GS1 and some global sustainability standards.
As a conforming UNTP extension, AATP must also re-use and not re-define all UNTP data elements so that AATP credential retain their cross-industry and cross-border interoperability. Therefore the data governance scope of AATP is to define data elements needed for Agricultural traceability and transparency that are not already defined by UNTP. However there are several existing agriculture specific international or national vocabularies such as the codex alimetarius from the UN Food and Agriculture Organisation (FAO) or national standards such as the bovine language guidelines from Meat & Livestock Australia.
As shown in the diagram, a valid AATP credential instance (eg a livestock passport for a specific animal) MUST
- reference and conform to the AATP JSON Schema that defines the valid data structure. The JSON Schema is a complete description of the entire credential and includes all data elements from VCDM, and UNTP, and AATP. It offers a simple and complete schema for implementers to follow.
- reference JSON-LD @context files(s) that map every extended data element to semantic meaning defined in an AATP reference vocabulary. JSON-LD @context files are a non-overlapping set of vocabulary mappings and therefore the instance file will reference the VCDM context, and the UNTP context, and the AATP context.
Consequently the scope of AATP data governance is
- to define data models and JSON schema for AATP credentials as required.
- to select reference vocabularies relevant to the agriculture sector.
- to define a JSON-LD @context file for each AATP credential.
- to maintain an AATP reference vocabulary for all elements that cannot be mapped to an existing standard vocabulary.
Development Process
All changes to AATP vocabularies, schema, and context files will follow a consistent development process as shown in the workflow diagram below. Each version change follows the entire process but bug fixes can bypass much of the development process.
The process ensures that no artifacts are released to production unless they are tested and approved. The process also provides for faster releases when there is no requirement to change AATP core vocabularies.
Version Management
All AATP artifacts are rigorously versioned following semver best practices.
- Version numbers are indicated as a dot-separated triple {major}.{minor}.{patch}. For example version 2.3.4.
- {patch} version number increments indicate non-breaking bug fixes that do not add new capabilities of features. For example, implementers should see no difference between version 1.4.5 and version 1.4.6.
- {minor} version number increments indicate non-breaking enhancements. For example, implementations of version 1.4.5 are still compatible with version 1.5.0 but may not take advantage of new features.
- {major} version number increments indicate significant and breaking releases. For example implementations of version 1.5.0 will be incompatible with version 2.0.0 and may fail in unpredictable ways.
Release Management
Every version change is automatically published to the AATP test end point following a defined URL structure
- Structure :
https://test.agtrace.com.au/aatp/{domain}/{version}/{artefact}
- Example :
https://test.agtrace.com.au/aatp/livestock/1.2.3/dlp-context.jsonld
When a given version meets criteria to justify a production release then the governance process will approve a release. Not all versions will be released to production. Production releases will be published as follows.
- Structure :
https://vocabulary.agtrace.com.au/{domain}/{version}/{artefact}
- Example :
https://vocabulary.agtrace.com.au/livestock/1.2/dlp-context.jsonld
Allowed domains are aatp-core
, livestock
, horticulture
, grains
. More domains may be supported in future.
Development Tooling
AATP has a complex set of dependencies, includes a rich set of versioned technical artifacts, and must follow a rigorous and collaborative development process. High quality tooling is essential to support AATP governance. The tooling includes
- Data Modeling Jargon data modeling tool provides business domain expert in AATP development working groups and teams with a tool for developing logical data models and vocabularies that requires relatively little technical expertise. Complex physical artifacts such as JSON schema, JSON-LD context files, and RDF vocabularies are all generated from the Jargon tool using built-in transformation rules. Jargon also provides an easy way to map AATP models to existing external vocabularies.
- Delivery Management GitHub is the worlds most popular open source development platform. It provides version controlled content management, project management, release workflows, and many more features. It is at the heart of AATP governance. Jargon generated artifacts such as livestock passport schema are pushed to GitHub and then GitHub release workflows are used to publish the AATP artifacts.
- Publication Modern digital standards including all data element definitions must be published to permanent and highly available web locations. The Amazon Cloud S3 Service provides an effective and low cost solution which is also used by the UNTP. GitHub workflows will automatically publish new releases to AATP test and/or production hosting locations.
- Implementation Support requires a help-desk management system (implemented using Jira) as well as a suite of references implementations and test services - which are built from open source code in GitHub and deployed to Amazon infrastructure. Feedback and experience from actual implementations provide valuable input to close the loop back to the start for the next release of AATP.
- AATP Public Engagement is achieved using a website that is generated from content management in GitHub and presented for easy navigation using docusaurus
This collection of tooling provides AATP with a low cost and highly effective mechanism for long term governance.
Implementation Conformity Scope
Governance applies not only to the development of AATP itself but also to the ecosystem of AATP implementers. A Livestock passport issued from a farm system should be discoverable and readable by a processor system without any specific system to system testing. To achieve such interoperability, AATP must provide a comprehensive conformity testing service that can provide confidence that, once any system has successfully completed testing, it will produce artifacts that are interoperable with any other system.
Interoperability depends not only on well tested conformant implementations but also only alignment in the scope of what has been implemented. There are several AATP credential types and each may transition through multiple major versions. Maximum interoperability is achieved when both an issuing system and a verifier system support the same credential type major version - such as a digital livestock passport v1.0. However, even when two implementers do not support the same credential type & version, there are still some valuable fallback:
- if both credentials (eg livestock passport v2 and horticulture passport v1) are built on the same underlying UNTP credential such as the digital product passport v1 - then there will still be a useful level of interoperability even if the specific extended attributes are not processable.
- even when a verifier party has zero technical implementation or total misalignment between technical implementations, the credentials are still human readable and so can still be manually processed.
The diagram shows the different role types in a typical AATP implementation and which credential types they would be likely to implement. There are four roles.
- The conformity assessment body (CAB) is the simplest one. A CAB issues credentials such as emissions or deforestation credentials to producers or manufacturers. There is likely to be a wide variety of conformity credential types but all will follow the same interoperable UNTP Digital Conformity Credential core. The conformity credentials are issued to producers or manufacturers who may publish them together with their own issued credentials.
- Registry operators will issue identity credentials to their members (typically the producers and manufacturers) in much the same way that CABs issue conformity credentials. Registry operators must also operate a link resolver service which, given a registered identifier (eg a GTIN) will return a list of links to further information about the identifier. The links may point to data hosted by the register but more often will redirect to data (such as digital passports) hosted by the producer / manufacturer.
- Producers and manufacturers (processors) are issuers of product credentials, facility credentials, and traceability events. These credentials should also be published and linked to the corresponding product or facility identifiers (eg NLIS or PIC) using a link resolver service. The conformity credentials and identity credentials provided by CABs and registers may also be published and linked to the same product or facility identifiers.
- Finally verifiers will resolve product and facility identifiers to retrieve a bundle of related credentials and then will verify the collection of related credentials against a set of business rules. Some of the business rules will be common across all verifiers and therefore may be bundled as AATP standard executable rules.
Implementation Conformity Process
Implementers will follow a structured process to achieve and maintain AATP conformance - as indicated in the workflow diagram below and described in detail in the implementation guidance pages.
- Once satisfied that there is a positive case for implementation (please refer to the business case section of this website) then implementers are encouraged to publish their intent to implement the AATP following the process outlined in the implementation register.
- Once an implementation has completed build and has passed conformity testing then the implementer should update their entry on the AATP implementers register accordingly. At this point the maintenance life-cycle commences which includes
- Re-testing and updating the implementation register when either the implementer software product major version or supported AATP credential major/minor version changes.
- providing simple high-level and de-personalised quarterly reports to the AATP secretariat against KPIs defined in the value assessment page.