Skip to main content

USDA Economic Research Service Secure Data Enclave

Sun sets over a field
Providing secure hosting, management, and access to restricted-use data about the U.S. food supply
  • Client
    Economic Research Service of the U.S. Department of Agriculture (USDA)
  • Dates
    2006 – 2024

Problem

Researchers needed secure, remote access to high-quality USDA data. 

Much of the government’s data about the nation’s food supply come from third parties. In their raw form, these data often contain discrepancies, mistakes, and gaps. This makes it extremely difficult for academic and government researchers to produce accurate studies and reports about agricultural production, hunger, and food insecurity.

Solution

NORC cleaned and harmonized USDA information and hosted it in the NORC Data Enclave®. 

Beginning in 2006, the USDA Economic Research Service (ERS) employed the NORC Data Enclave® to host, normalize, and provide access to restricted-use datasets. Data sources included the Agricultural Resource Management Survey (ARMS), the National Household Food Acquisition and Purchase Survey (FoodAPS), and the third-party Circana (formerly Information Resources, Inc.) Scanner data. 

NORC coordinated with USDA to regularly ingest, clean, standardize, and enhance inbound data. Once the data passed quality control, NORC gave authorized researchers access to the data via NORC's secure and controlled environment, the NORC Data Enclave®. Through the NORC Data Enclave®, researchers could perform complex analyses and gain insights that would not be possible with public-use data. The platform's secure infrastructure and restricted access controls helped to protect the confidentiality and privacy of individuals and organizations represented in the data.

Result

NORC enabled a diverse community of researchers to find solutions for sustaining our nation’s farms and food supply.

The partnership between USDA ERS and NORC has produced a wealth of trustworthy data that informed innovative research and supported a vast researcher base. Topics have included the growth of food insecurity during the COVID-19 pandemic and the spread of food deserts in low-income neighborhoods. Ensuring high data utility and quality has translated into researchers finding increased success publishing their ERS-based research.

NORC staff were committed to working closely with USDAERS to ensure the data remained secure and accurate, providing researchers with the insights they needed to address important agricultural and food-related issues.

“The third-party IRI data processed into the Data Enclave must be standardized and harmonized before researchers use them. This standardization process creates consistency where third-party data collection methods may change from year to year. Partnering with USDA ERS, NORC employs a robust standardization process that provides a consistent and controlled data experience for the research community.”

Senior Data Scientist

“The third-party IRI data processed into the Data Enclave must be standardized and harmonized before researchers use them. This standardization process creates consistency where third-party data collection methods may change from year to year. Partnering with USDA ERS, NORC employs a robust standardization process that provides a consistent and controlled data experience for the research community.”

Explore NORC Economics Projects

Entrepreneurship in the Population (EPOP)

Tracking the U.S. population’s experiences with and interest in entrepreneurship and self-employment

Client:

Ewing Marion Kauffman Foundation

Artificial Intelligence for Enhancing Data Quality, Standardization & Integration

Applying innovative data science methods to create datasets that support evidence-based decision-making

Client:

National Center for Science and Engineering Statistics