Welcome to ESRI Blogs

ArcGIS Online moving to Google / Bing tiling scheme: What does this mean for you?

Earlier this year ESRI announced that ArcGIS Online services will be migrating to the Mercator-based tiling scheme used by Google Maps and Bing Maps. The ArcGIS Online engineers have been busy caching tiles for months in anticipation of this switch, which is anticipated to occur by the end of this year. This post is about how the change may affect you. At the end of the post we also provide steps on how to make the change for your services.

Why a tiling scheme change?

Since the release of ArcGIS Online three years ago, the 2D services have used the WGS 1984 geographic coordinate system and a 512 x 512 pixel tile size. Google and Bing, in contrast, use a modified Mercator projection and a 256 x 256 tile size. The scale sets used by both tiling schemes are similar, but not equivalent.

Why didn’t ArcGIS Online originally choose to match Google and Bing? Interestingly enough, the first ArcGIS Online services were designed in 3D for viewing in ArcGlobe and ArcGIS Explorer. Without getting into the technical details, it’s enough to say that the coordinate system and scales used in the 2D ArcGIS Online tiling scheme have their roots in the ESRI globe technology for which ArcGIS Online was originally built.

With the broad uptake of the ArcGIS Web APIs, the 2D ArcGIS Online services have become very widely used. Some organizations struggle with choosing either the ArcGIS Online tiling scheme to match their ESRI software stack, or the Google / Bing tiling scheme to match a better-known standard. With a unified tiling scheme for the three services, the decision gets a lot easier.

A few organizations are required to support mashups with both ArcGIS Online and Google Maps or Bing Maps. After the ArcGIS Online tiling scheme change, these organizations will no longer have to maintain two caches.

What does this mean for you?

If you are getting ready to create a very large cache to overlay ArcGIS Online, it may be best to create the cache in the Google / Bing tiling scheme, anticipating the change.

If you are not able to re-create your cache at this time, the old services will remain available for a minimum of six months. They will be offered “as is” and will not receive any further data or cartography updates.

Advantages of switching to the Google / Bing tiling scheme

The biggest advantage of switching to the Google / Bing tiling scheme is standardization. This tiling scheme is well-known and widely used. Whether you love the Mercator projection or hate it, it is now customary in Web maps designed for mass consumption. In the end, simplicity of math (you can fit the world on a square at the smallest scale) determined the way most Internet users expect to see the world.

There are some subtle performance advantages to the Google / Bing tiling scheme. Because the tiles are only 256 x 256 pixels, less tile area falls outside the periphery of the map. This means you have to send less data across the wire. The smaller tiles also enhance the perception of the map loading faster, compared with waiting for the 512 x 512 “chunks” of map to appear.

Challenges associated with the Google / Bing tiling scheme

If you re-create your caches in the Google / Bing tiling scheme, you need to anticipate a few issues. First, because the tiles are 256 x 256, you’ll be creating roughly four times as many tiles as you had previously in your ArcGIS Online cache. The larger number of files in your cache will increase cache copying time. The smaller tile size also means you have to send more files to the client during a map request.

Your cache size on disk will probably also increase. Some of the 256 x 256 tiles can get very small in size if they contain few features; much smaller than the 4K default minimum cluster size on Windows. Some organizations have saved space by storing their caches on disks or partitions formatted with a smaller minimum cluster size, such as 1K. This reduces the discrepancy between “Size” and “Size on disk”.

Finally, the Mercator projection is going to stretch your map vertically, especially if you work with extreme latitudes. Besides affecting the appearance of the map, this distortion may cause you to create many more tiles than you might otherwise expect. At these latitudes, it is critical to target your cache at just the scales and geographies that you need. You may want to enable on-demand caching for the most isolated regions. The distortion introduced by the Mercator projection also means that before you measure a feature such as a user-drawn polygon, you should project the feature into a more locally-tailored coordinate system such as UTM or State Plane.

How do you create a cache to match the Mercator-based ArcGIS Online services?

Here’s the workflow for caching a map to match the Mercator-based ArcGIS Online services:

  1. Open your source map document in ArcMap and set your data frame coordinate system to WGS 1984 Web Mercator. You don’t have to re-project the source data, although this can make caching go faster. Some people even create a one-way replica of their geodatabase in the WGS 1984 Web Mercator coordinate system and use that replica just for caching.
  2. Publish a map service.
  3. Open the Service Properties and click the Caching tab. Choose to draw the map service Using tiles from a cache you will define below.
  4. Click Load tiling scheme from and select Google Maps / Microsoft Virtual Earth. Once the scales load, do not add or remove scales or change the tile size.
  5. Create tiles for just a small area of your map, using a feature class to constrain the caching extent if necessary.
  6. Test your new cache. There are already a few new ArcGIS Online services that use the Google / Bing tiling scheme, such as the World Topographic Map. Build a simple test application with these maps to evaluate how your cache overlays with ArcGIS Online in the Mercator projection. If your data doesn’t align, see the alternate steps below for creating a cache in WGS 1984 Web Mercator (Auxiliary Sphere).
  7. Once everything looks okay, open the caching tools again and create all the tiles for your cache.

Exceptions and Web Mercator (Auxiliary Sphere)

There are a few scenarios where you will have to follow some alternate steps to get your caches to overlay correctly with the Mercator-based ArcGIS Online services. The conditions are:

  • You’re overlaying a cache with ArcGIS Online in the Web ADF OR
  • Your data did not align correctly when building a test cache with the above steps. This is most often because your source data uses a datum other than WGS 1984 or NAD 83

In the above two scenarios, you need to publish your cache using the WGS 1984 Web Mercator (Auxiliary Sphere) coordinate system which is the exact coordinate system used by ArcGIS Online. The Web ADF requires an exact coordinate system match for cache overlays. Also, this coordinate system makes it easier to perform some datum transformations.

  1. Open your source map document in ArcMap and set your data frame coordinate system to WGS 1984 Web Mercator (Auxiliary Sphere). While you are doing this, apply any datum transformations to WGS 1984 that you require.
  2. Follow the steps in ESRI Knowledge Base Article 37329 to create a cache for the service.

Migrating map tiling schemes in the ArcGIS Online Help has more details about the switch and the WGS 1984 Web Mercator (Auxiliary Sphere) coordinate system used above.

Contributed by Sterling Quinn of the ArcGIS Server development team.

Published Friday, November 20, 2009 1:42 PM by sterlingdq
Filed under: ,

Comment Notification

If you would like to receive an email when updates are made to this post, please register here

Subscribe to this post's comments using RSS

Comments

# re: ArcGIS Online moving to Google / Bing tiling scheme: What does this mean for you?

So, for people who have data in NAD83 and are just now starting to cache to match ArcGIS Online/Bing/Google, should they use "Web Mercator - WKID 102113" or "Web Mercator (Auxillary Sphere) - WKID 102100" ?

The following technical article implies that 102100 should be used from the start:

http://support.esri.com/index.cfm?fa=knowledgebase.techarticles.articleShow&d=37329

But the blog article above basically says to only use 102100 only if your test cache in 102113 doesn't align properly.

We just completed some large California statewide caches using NAD83 source data and cached to 102100 from the start using the transformation "NAD_1983_To_WGS_1984_5" (which I've been told is the most accurate transform between NAD83 and WGS84 for the California area).  It seems to align correctly.   Is that not the most accurate way to prepare for the new ArcGIS Online services using NAD83 data?

Tuesday, December 01, 2009 2:20 PM by will

# re: ArcGIS Online moving to Google / Bing tiling scheme: What does this mean for you?

@will - Caching with WKID 102100 as you have done is a valid approach. As you probably found out, following the steps in KB 37329 requires you to download and manually import a tiling scheme file. We felt it was easier in this blog post to direct people to the built-in tiling scheme (102113) when possible.

Tuesday, December 01, 2009 3:23 PM by sterlingdq

# re: ArcGIS Online moving to Google / Bing tiling scheme: What does this mean for you?

I am relatively new to ArcGIS Server and the whole caching story. We want to start using some cached services. I would like to know what are the implications of having your data in say WGS 1984 geographic and also using an ArcGIS Online/Bing/Google cached service?
Friday, December 04, 2009 2:57 AM by Julian

# re: ArcGIS Online moving to Google / Bing tiling scheme: What does this mean for you?

@Julian - You can keep your source data in WGS 1984 geographic if you want, but you have to project the data frame of your map document to Web Mercator as described in the instructions above.

If you have a lot of area to cache, or very large scales, you may want to re-project a copy of your source data into Web Mercator and re-point the data sources in your map document at the re-projected data. That will speed up tile creation because no data will have to be projected on the fly. If you're making a fairly small cache (a city or a small county) then it may not be worth your trouble to re-project.

Friday, December 04, 2009 10:31 AM by sterlingdq

# re: ArcGIS Online moving to Google / Bing tiling scheme: What does this mean for you?

Does this only apply if we want to overlay data with ArcGISOnline or Google/Bing services? Do we need to worry if we are using our cached base map services on their own with our own business data? Would it still be prudent to change the tile size for our cache to 256x256 anyway to take advantage of the performance benefits you outlined?
Tuesday, December 08, 2009 5:17 AM by Gareth Baker

# re: ArcGIS Online moving to Google / Bing tiling scheme: What does this mean for you?

@Gareth - The above steps are only necessary if you are overlaying your caches with the Mercator-based ArcGIS Online services, Google Maps, or Bing Maps. For other caches, if you have the resources to create and store a larger number of tiles, then switching to 256 x 256 can still be a good move for performance. Before you make the change, I suggest making a small test cache in the 256 x 256 size and comparing the performance against your existing cache.

Tuesday, December 08, 2009 10:05 AM by sterlingdq

# re: ArcGIS Online moving to Google / Bing tiling scheme: What does this mean for you?

We are using several services in our online application. Will the url's remain the same? We use http://server.arcgisonline.com/arcgis/services. Also, we publish MSDs from SDEs that can be in State Plane, UTM or WGS 1984 coordinate systems, should we make any adjustments to our underlying mxds?
Thursday, December 10, 2009 7:42 AM by Tracy Schumacher

# re: ArcGIS Online moving to Google / Bing tiling scheme: What does this mean for you?

@Tracy - Great questions. The updated, Mercator-based services will actually have new names. So your existing applications will continue to work without you having to change the URL. Your applications will continue to work until the old services are retired after a period of at least 6 months.

In order to publish an MSD that uses the WGS 1984 Web Mercator, you will have to project your MXD data frame to WGS 1984 Web Mercator and re-save the MSD. The MXD is not connected to the MSD, so once you've re-saved your MSD, you could conceivably change the MXD data frame back to its original coordinate system. Does this answer your question?

Thursday, December 10, 2009 11:24 AM by sterlingdq

# must the tile size be the same?

Hi Sterling, I have had the impression for a long time that in order to overlay two layers in a map, the tiling schemes must be the same: the same scale levels, the same tile size, the same projection. Yet I just discovered that I have been overlaying a 512x512-pixel tiled map service layer over a 256x256-pixel one, and it displays properly. Does the tile size actually not have to be the same? If that's the case, we could choose to have our own layers cached in 512x512, for disk space reasons, and still combine them with Google or Bing layers, provided they are at the same scale levels and in the same projection -- correct? We are using ArcGIS Server 9.3.1 and the JS API 1.5. Thanks, Lars
Monday, December 21, 2009 1:50 PM by Lars

# re: ArcGIS Online moving to Google / Bing tiling scheme: What does this mean for you?

@Lars- In the ArcGIS Server documentation, we make the general statement that tiling schemes should match when overlaying caches. Because caches are just image files sitting in an organized folder hierarchy, tile caches can be consumed by many different types of ESRI and non-ESRI clients. We cannot guarantee that all those clients will be engineered to successfully overlay the 512 tiles over the 256 tiles; however, the map controls in some of the ESRI Web client APIs can do this.

I have not tested this "feature" in all the APIs and do not have a specific list of which ones work with non-matching tile sizes. If you've tested in all of your client applications, things look okay, and you want to keep your 512 x 512 tiles to preserve disk space, I would say go forward, maintaining some caution.

Wednesday, December 23, 2009 1:29 PM by sterlingdq

# re: ArcGIS Online moving to Google / Bing tiling scheme: What does this mean for you?

What is this WKID 102113? Why can't ESRI use the official EPSG code from the EPSG registry? Can you verify that this is exactly the same as the official EPSG:3785, or is "WKID 102113" different in some way from the official CRS definintion?
Tuesday, March 16, 2010 6:22 PM by jamie

# re: ArcGIS Online moving to Google / Bing tiling scheme: What does this mean for you?

@jamie - For a long time EPSG refused to assign a code to this coordinate system; therefore ESRI created the WKID codes 102113 and 102100.

When EPSG did assign a code, they used 3785, but later changed it to 3857. ArcGIS 10 will follow ESRI practice of using an EPSG code when one exists, and will advertise the coordinate system of the service as 3857. ArcGIS 10 and all Web APIs are being designed to recognize EPSG 3857, ESRI WKID 102113, and ESRI WKID 102100 as equivalent.

Wednesday, March 17, 2010 9:55 AM by sterlingdq

Leave a Comment

(required) 
required 
(required)