Electric utilities recognize the importance of data quality because good data provides them with the ability to efficiently perform planning and analysis and outage management. So, what can you do to validate your electric network data? You can start with the list below and begin reviewing your geometric network to validate the connectivity of edges and junctions. This will help ensure you do not encounter problems when running a trace on your network.
I’ve identified the top business rules that need to be validated and corrected before moving on to any advanced data validation. Continue reading
In the previous blog post, I discussed several of the attribute checks you could use to validate attribute updates made on the source parcel data before loading into the fabric. As a continuation, in this post I’ll discuss how to use the geometry and topology checks included in ArcGIS Data Reviewer.
Several checks exist that can help with examining the geometry of the lines and polygons. The first, Invalid Geometry check, looks for features with empty or null geometries as well as non-simple geometries. This check can be run on both the Parcel_Lines and Parcel_Polygons feature classes.
In preparation for loading your parcel data into the parcel fabric there are a number of criteria you have to meet. A critical step in the process is to match your source data to the Local Government Information Model, with all its domains and specific attributes. In this blog I’d like to highlight some of the automated checks in ArcGIS Data Reviewer that can help you validate your data prior to migrating it into this new schema, as it is better to identify any errors before you move to the fabric.
In a previous blog we discussed how to automate your data validation workflows by integrating ArcGIS Data Reviewer with ArcGIS Workflow Manager. We also discussed some of the basic functions you can perform with the Reviewer
Custom Steps. For this blog I’d like to take it a step further and describe other ways in which you can use the custom steps. I’ll also introduce additional functionality in Workflow Manager that you might find useful when integrating
with Data Reviewer.
Working with Reviewer sessions
Reviewer sessions are a way of filtering records in the Reviewer workspace to show only those records you are interested in. Last time, we outlined how to use tokens with the Create a Reviewer Session custom step to create unique sessions for each job based on the Job ID. There are other ways you can create sessions depending on your workflows. For example, if you have unique sessions that already exist for each user, you can use tokens like the [JOB:ASSIGNED_TO] in the Run Reviewer Batch Job custom step to write the errors to the existing sessions.
Several times I’ve been asked, “what’s the best way to automate data validation workflows?” With the release of ArcGIS 10, this can be achieved by integrating the ArcGIS Workflow Manager and ArcGIS Data Reviewer extensions. Data Reviewer has added custom steps that can be used within a Workflow Manager workflow. In this blog topic, I’ll describe how you can configure these custom steps.
If you don’t already know, using Workflow Manager you can define workflows that model your business processes and track the progress of assigned tasks. The steps in the workflow can be configured to execute functions like sending notifications, opening applications like ArcMap, and running geoprocessing tools.
Data Reviewer allows you to manage and track quality control of your data. You can automate data validation using rules stored in a batch job. A Reviewer session is used to store information about any errors that are found and to track issues through their life-cycle to ensure they are fixed and verified.
With the User Conference just 10 days away, we’d like to remind you to take advantage of the Water Utility Data Health Check service that we are providing at the Geodatabase Management island. There are still some slots left if you’d like to sign up. Just send an email with your name, organization, contact info, and preferred time slot to firstname.lastname@example.org.
With the Esri International User Conference less than a month away we have been receiving several queries about activities related to ArcGIS Data Reviewer at the conference. Here’s the list that we’ve compiled.
ArcGIS Data Reviewer experts will be available at the Geodatabase Management island in the Esri showcase area to talk about and demonstrate this extension. The showcase timings are:
- Tue, July 12th from 9:00 AM – 6:00 PM
- Wed, July 13th from 9:00 AM – 6:00 PM
- Thur, July 14th from 9:00 AM – 1:30 PM
If you are interested in getting a high level overview of the ArcGIS Data Reviewer extension be sure to attend the free live training seminar scheduled for June 16th. Our Data Reviewer product experts will be presenting and demonstrating various topics including:
- Automated and visual review of your data
- Manage and track error information
- Report and assess data quality
For more information about this seminar, please visit the Esri training site here.