Comprehensive documentation for SDCStudio - AI-powered SDC4 compliant data modeling platform

Terry Pratchett’s Discworld (which also appears in mythologies and other stories) is a captivating realm that attracts millions of geeks from all over the world. The structure of this world is familia...

YouTube video by Neuro Symbolic

Proceedings of the National Academy of Sciences (PNAS), a peer reviewed journal of the National Academy of Sciences (NAS) - an authoritative source of high-impact, original research that broadly spans...

End the cost and loss of data migration.

In the world of data science, we’re obsessed with clean data.

Tests of large language models reveal that they can behave in deceptive and potentially harmful ways. What does this mean for the future?

For too long the public sector has made too slow progress toward information sharing to advance its myriad missions and more effectively serve citizens. Recent administration guidance underscores the gap between the current reality and the opportunity of effective sharing, linking and using data and information for applications as diverse as preventing fraud to improving the utility and experience with government services. NIEMOpen meets the moment. Will the federal government? What is NIEMOpen? NIEMOpen is the current instantiation of the National Information Exchange Model, a core part of the nation’s response to the tragic information sharing failures on Sept. 11, 2001, fused with governmentwide efforts to advance the use of data and enterprise architecture. In its original incarnation, NIEMOpen helped agencies standardize information sharing specifications and implementations at both the system and semantic levels. It helped agencies and information sharing partners move away from bespoke point-to-point interconnects. In particular, agencies investing up front in the use of NIEMOpen experienced lower costs and faster time to interconnect, as well as much greater and more useful levels of reuse of data and information. NIEM’s key innovation is its approach to model governance. Different domains, such as law enforcement, immigration, cybersecurity, human services, military operations, biometrics or emergency management governed their data semantics separately, in accordance with their needs. All of the NIEM domains (currently 19), come together to agree on common data semantics for core elements, such as to uniquely describe an individual or a conveyance, and the precise naming and design rules to be used by all. Individual domains commit, over time, to normalizing their data definitions to those in the common core. This has been an iterative process. Over two decades, NIEM has six major releases, and many more minor point releases of the model, all driven through federated model governance by its users via individual domain governance. This process is culminating this fall in the reveal of NIEMOpen 6.0 in November. The core value generated by NIEMOpen lies in a persistent challenge. Without a common, compatible understanding of data, computer systems cannot accurately interpret information. This leads to the conceptual “N-squared problem,” where each new system connection demands a unique integration point, exponentially increasing complexity and cost. NIEMOpen enables systems to “speak” just two languages: their own and NIEMOpen. While it requires a modest investment and governance buy-in up front, the payback for this approach is high. For example, the Department of Homeland Security estimated an overall cost savings of 72%, or $18,747,757, when using NIEM over custom XML development for three exchanges reused across roughly 100 systems, according to a 2025 paper on NIEMOpen. NIEMOpen is not your parent’s NIEM The NIEMOpen community is driving innovation in its governance, business model and modernized technical approach, including support for artificial intelligence applications. NIEMOpen transitioned from federal stewardship to the Organization for the Advancement of Information Standards (OASIS) in November 2023, further strengthening its open-source, community-driven roots. This move, demonstrating American standards leadership, is paving the way for formal accreditation, including with the American National Standards Institute (ANSI) and International Organization for Standardization (ISO). The transition to OASIS removes barriers and opens the way for international partners such as the government of Canada, the North Atlantic Treaty Organization and others to strengthen adoption, use and support for NIEMOpen. OASIS’ stewardship, and the involvement of the Integrated Justice Information System Institute, deepen connection to industry for tools, training, product integration and alignment with the marketplace. Federal sponsorship, especially with domain governance and maturity, has been uneven over the years. Different agencies, starting with the departments of Justice, Homeland Security, Health and Human Services and now Defense, have taken the lead running the NIEM program. Many federal chief data officers have inherited varying levels of stakes in active or moribund NIEM domains. Under OASIS’ leadership, there is much less bureaucracy for stakeholders broadly across the public sector to engage as their missions demand. The core technical innovation with NIEMOpen is to express its structured data models in a technology agnostic way with multiple modern representations, an application programming interface and real-world support for creating ontologies and knowledge graphs. For example, NIEMOpen enables a standards-based way to integrate the use of resource description framework and JSON/JSON-LD. These formats are widely used in modern web services and linked data environments, making them central to AI and knowledge representation. This structured, semantically rich reference data is ideal for building knowledge graphs from real-world data and leveraging retrieval-augmented generation with graphs (GraphRAG) techniques. For example, NIEMOpen-standardized data about individuals, organizations, locations and activities from different agencies with a common mission could be fed into a shared knowledge graph, potentially leveraging entity resolution tools. When a large language model is used in a GraphRAG architecture, it can then query this knowledge graph to retrieve highly precise, factual context about interconnected entities or events. This significantly enhances the accuracy and trustworthiness of AI-generated insights, moving to contextual and interoperable understanding crucial for sophisticated and aligned decision support. A call to action The transition of NIEM to NIEMOpen under OASIS signifies a key advancement in establishing open standards for data interoperability. This initiative not only reduces costs and enhances the efficiency of information sharing across public sectors but also positions the U.S. to provide leadership in global standard-setting. As NIEMOpen’s emphasis on community-driven, mission partner development and adherence to established standards will pave the way for improved data sharing, facilitating trust and collaboration in critical areas such as AI and cybersecurity. Finally, it is incumbent on federal partners to reinvent their approach to NIEM by accelerating agency and government wide data standard efforts under OASIS’s stewardship, investing in and supporting the maturation of domains in their areas of responsibility and collaborating with stakeholders in the open. NIEM Open also opens up pathways for federal CDOs to advance government-wide data standards and mission-impactful responsible information sharing. Kshemendra Paul is expressing these views in his personal capacity. The views expressed are his and not those of the U.S. government or any of its agencies. Paul has served for the past 17 years as a senior executive in the White House and across many federal agencies, leading people, building coalitions and advancing progress against complex public sector challenges. He has developed an aptitude and passion for using data and technology, focused on improving government management and information sharing to better serve the American people. Previously, Paul held a variety of private sector technology innovation, development, consulting and leadership roles. He received Bachelor of Science degrees in electrical engineering and mathematics, and a Master of Science in electrical engineering from University of Maryland, College Park.The post NIEMOpen: Semantic interoperability in the AI age first appeared on Federal News Network.