Data Management and Modernization

A look into how modernizing field data collection increased efficiency and improved data management

Data Modernization Goals

  • Updating workflows from pen/paper and hand held GPS devices
  • Better data storage and management plans
  • Increased accessibility and ease of comprehension of data to public

Shellfish Sanitation Shoreline Sampling

Examples of pollution sources

Historical Data Collection

  • Printed out maps to take into the field to locate previously recorded points
  • Handheld Trimble GPS units to record data
  • Individual pictures taken on a digital camera

Field Maps Data Collection

  • Update workflow to utilize iPads and ArcGIS Field Maps
  • Decreased time in the office before and after data collection
  • Decreased time at each location
  • Access to historical records and images
  • Download offline maps
  • Ability to query data more easily

ArcGIS Web Application Pollution Source Querying

Recreational Water Quality

Goals

Current IBEAM data entry

  • Move database from SQL to ArcGIS online
  • More user-friendly data entry process
    • Daily data as well as EPA submission
  • Improved data visualization for public
  • Maintain current backup workflow, while making it more efficient

Current Workflow

  • SQL database
    • Minimal staff support
  • Data entry is clunky and not intuitive
  • Export process for EPA submission difficult and tedious

Updated Workflow

  • Created a geodatabase with a feature layer of sampling station locations and two related tables
    • Advisories and sampling data
  • Excel sheet with dropdown lists and macros walk through data entry
  • ArcPro to ArcGIS Online append process to move data from excel sheet to database
    • Excel sheet allows for built in backup and double check of data calculation
  • Publicly available tool for public to see beaches that have advisories as well as view and download raw data as necessary

Screenshot of ArcPro project with Recreational Water Quality geodatabase, layers and related tables, and Append tool.

New public facing Recreational Water Quality tool

Shellfish Inspection Forms

Example of the rough draft

Current workflow

  • Carbon Copy paper
  • A copy is left with the dealer
  • Manually update in database

Future goals

  • Historical data included in database
  • directly interacting with larger Division of Marine Fisheries database
  • Survey123

Discussion Questions

Are there any examples of successes with data collection modernization and management?

What innovative technologies are you looking into that you haven't invested in yet?

What are your data modernization goals for your organization?

What are some issues that prevent those goals from being met?

What would make meeting those data modernization goals easier?

If you have any question please feel free to reach out. elizabeth.mason@deq.nc.gov shannon.myers@deq.nc.gov

ArcGIS Web Application Pollution Source Querying

Current IBEAM data entry

Screenshot of ArcPro project with Recreational Water Quality geodatabase, layers and related tables, and Append tool.

New public facing Recreational Water Quality tool

Example of the rough draft