Tag: GitHub

An Introduction to Big Data

ArcGISHadoop

Two years ago the Big Data team released GIS Tools for Hadoop on GitHub. GIS Tools for Hadoop is an open source project that allows users to integrate Hadoop (a distributed big data platform) with big spatial data, complete distributed … Continue reading

Posted in Geodata | Tagged , , , | 5 Comments

Esri Solutions tools are available on GitHub

Current Release

Esri Solutions tools are available on GitHub in the Solutions Geoprocessing Toolbox repo at https://github.com/Esri/solutions-geoprocessing-toolbox.  This repo contains a set of toolboxes of Python and model tools that you can use in your military, intelligence, and emergency management workflows. We’ve … Continue reading

Posted in Defense | Tagged , , , , , , , , , , , , , , | Leave a comment

The Build Elevation Mosaic Tools toolbox is now available

Build Elevation Mosaics Toolbox

The Build Elevation Mosaic Tools toolbox (version 10.2.2.1) (version 1.0.2) is now available for download for ArcGIS 10.2.2.  It contains tools to help you manage your elevation data as mosaic datasets. Why build elevation mosaic datasets? Building mosaic dataset makes it simple … Continue reading

Posted in 3D GIS, Defense, Imagery | Tagged , , , , , , , , , , , , , , , , , , , , , , | 2 Comments

Predictive Analysis and Suitability Tools

route

The Esri Oceans/Maritime community may be interested in two sets of tools originally developed for other sectors, but could be very useful for ocean and coastal science and resource management applications. The first set of tools is the ArcGIS Predictive … Continue reading

Posted in Analysis & Geoprocessing, Defense, Oceans & Maritime | Tagged , , , , , , , | Leave a comment

Setting up a small budget Hadoop Cluster for Big Data Analysis

At the 2014 Esri User Conference, the Big Data team gave several presentations, including two technical workshops entitled: ‘Big Data and Analytics: The Fundamentals’ and ‘Big Data and Analytics with ArcGIS’. We presented our open source GIS Tools for Hadoop (shared on GitHub), as well as some research that we’re currently pursuing (exciting things to come!). We gave demos using both our open source tools as well as the prototype tools being currently researched.

For the demos (source data consisted of > 170 million data points that represent all the taxi cab trips in New York City in 2013), we ran all of our analytics on a Hadoop cluster back in Redlands. A twenty node cluster may seem like a big investment (and it can be); but, it doesn’t have to be. Enter the DREDD cluster… Continue reading

Posted in Geodata | Tagged , , , | 8 Comments

Big Data ST_Geometry Queries up to 20X Faster in Hive

The Big Data development team at Esri is excited to announce a major performance speedup in ST_Geometry for Hive, which is part of Esri’s open-source Spatial Framework for Hadoop.  The amount of performance gain depends on the type of spatial query run and on the size of the table in Hive.  The biggest gain comes with relational operations such as ST_Contains and ST_Overlaps.  In general, the performance gain will be greater with larger tables — exactly where it helps the most.

Continue reading

Posted in Geodata | Tagged , , , , , , | 1 Comment

ArcGIS Solutions symbols now have a repo on GitHub

SIGACTS Symbols

ArcGIS Solutions, which include Local Government, Utilities, Intelligence, and Military, to name a few, now have a GitHub Repo dedicated to symbols used in our templates. The first symbol set in the repo is the SIGACT symbols used in the … Continue reading

Posted in Defense | Tagged , , , , , , , , , , , , | Leave a comment

Vehicle Trip Discovery with GIS Tools for Hadoop

An interesting task in highway management is to study potential impact of driver carpooling, based on an analysis of automatically collected automobile GPS position data. To identify potential enhancements to carpool participation, we set out to study places that have the highest numbers of trips with similar origin and destination locations. The source data for this experiment consists of nearly 40 million vehicle position records assembled from a single day of GPS-collected vehicle positions. The position data consists of longitude and latitude along with date, time, and speed. We used the Hadoop MapReduce framework for distributed parallel computation, considering its capability for analyzing larger data sets. Continue reading

Posted in Geodata | Tagged , , , , | 7 Comments

ArcGIS Online admin tools available on GitHub

tools

Your organization’s admin console provides a core set of tools that administrators can use to manage users, items, and groups.  These tools are well suited for the regular administrative tasks, but there is sometimes a need for enhanced functionality not … Continue reading

Posted in ArcGIS Online | Tagged , , , | 1 Comment

Esri presentations, panels, and open-source projects at FOSS4G-North America

FOSS4G NA 2013 logo

This week a few members of the Esri team will be at the FOSS4G North America held in Minneapolis, Minnesota. FOSS4G-NA is yearly regional event of OSGeo – the Open Source Geospatial Foundation – highlighting community projects, open-source tools, and … Continue reading

Posted in Developer | Tagged , , , , , , , , | Leave a comment