Holistic Testing Schedule for Q3/Q4 2014

Here is the current schedule for our events through Q3/Q4 2014.

July 2014

  • Week of 7/7:                 Internal ArcGIS Pro Testing
  • Week of 7/14:               Software Feedback Island @ Esri UC (*San Diego, CA)
  • Week of 7/21:               ArcGIS Pro Localization for International Distributors
  • Week of 7/28:               Internal Portal for ArcGIS Testing

August 2014

  • Week of 8/4:                 ArcGIS GeoEvent Processor for Server (*Washington, DC)
  • Week of 8/11:               OPEN
  • Week of 8/18:               ArcGIS Pro: 3D & Imagery Experience
  • Week of 8/25:               OPEN

September 2014

  • Week of 9/1:                 OPEN
  • Week of 9/8:                 OPEN
  • Week of 9/15:               ArcGIS Pro
  • Week of 9/22:               ArcGIS Pro Localization
  • Week of 9/29:               OPEN

October 2014

  • Week of 10/6:                 OPEN
  • Week of 10/13:               OPEN
  • Week of 10/20:               OPEN
  • Week of 10/27:               Esri Electric and Gas GIS Conference (*Memphis, TN)

November 2014

  • Week of 11/3:                 OPEN
  • Week of 11/10:               OPEN
  • Week of 11/17:               OPEN
  • Week of 11/24:               OPEN

December 2014

  • Week of 12/1:                 OPEN
  • Week of 12/8:                 OPEN
  • Week of 12/15:               OPEN
  • Week of 12/22:               OPEN
  • Week of 12/29:               OPEN

Please check back often as we will update the schedule as more events are scheduled.  If you would like to participate in a holistic testing session for the next Esri software release, please e-mail holistictesting@esri.com for more information.

Posted in Uncategorized | Leave a comment

Visit the Software Feedback Island @ the Esri Developer Summit, March 10–13 2014

Stop by the Software Feedback Island at this year’s Esri Developer Summit. We will be located in the Esri Showcase in the Oasis Room on Monday through Thursday.

We want you to:

Get Involved in testing our upcoming releases

Share Ideas and influence the design of the software

Discuss Workflows so we build software to meet your needs

Provide Feedback to improve your experience using our software

Members of the Esri Products team will be available to discuss your comments and feedback on the quality of the ArcGIS software as well as your ideas on how to improve future software releases.  Hope to see you there.

Posted in Uncategorized | Tagged | Leave a comment

Holistic Testing Schedule for Q1/Q2 2014

Here is the current schedule for our events through Q1/Q2 2014.

January 2014

  • Week of 1/6:                 Internal Security Testing
  • Week of 1/13:               Internal Security Testing
  • Week of 1/20:               Internal Enterprise Testing
  • Week of 1/27:               ArcGIS Pro

February 2014

  • Week of 2/3:                 Internal Testing
  • Week of 2/10:               Internal Testing (ArcGIS 10.2.2)
  • Week of 2/17:               OPEN
  • Week of 2/24:               Internal Testing (iOS)

March 2014

  • Week of 3/3:                 Internal Testing
  • Week of 3/10:               Software Feedback Island @ the 2013 International Developer Summit
  • Week of 3/17:               Internal Testing
  • Week of 3/24:               Internal Testing
  • Week of 3/31:               ArcGIS WebApp Builder

April 2014

  • Week of 4/7:                 Internal Testing (ArcGIS WebApp Builder)
  • Week of 4/14:               OPEN
  • Week of 4/21:               ArcGIS Pro
  • Week of 4/28:               Internal Testing (Portal for ArcGIS)

May 2014

  • Week of 5/5:                 Internal Security Testing
  • Week of 5/12:               Esri Maps for Sharepoint
  • Week of 5/19:               Esri Maps for Office
  • Week of 5/26:               Internal Testing (ArcGIS for Server)

June 2014

  • Week of 6/2:                 Internal Testing
  • Week of 6/9:                 Internal Testing (Portal for ArcGIS)
  • Week of 6/16:               Explorer for ArcGIS
  • Week of 6/23:               Internal Testing (ArcGIS for Server)
  • Week of 6/30:               Internal Testing (ArcGIS Pro)

Please check back often as we will update the schedule as more events are scheduled.  If you would like to participate in a holistic testing session for the next Esri software release, please e-mail holistictesting@esri.com for more information.

- See more at: http://blogs.esri.com/esri/holistictesting/#sthash.01LmLvNR.dpuf

Posted in Uncategorized | Leave a comment

Holistic Testing Schedule for Q3/Q4 2013

Here is the current schedule for our events through Q3/Q4 2013.

July 2013

  • Week of 7/1:                 Internal Testing
  • Week of 7/8:                 2013 International Esri User’s Conference
  • Week of 7/15:               Internal Testing
  • Week of 7/22:               Internal Testing
  • Week of 7/29:               OPEN

August 2013

  • Week of 8/5:                 Internal Testing
  • Week of 8/12:               OPEN
  • Week of 8/19:               Internal Testing
  • Week of 8/26:               Analysis Online

September 2013

  • Week of 9/2:                 Internal Testing
  • Week of 9/9:                 Internal Testing
  • Week of 9/16:               Internal Testing
  • Week of 9/23:               ArcGIS Professional
  • Week of 9/30:               Internal Testing

October 2013

  • Week of 10/7:                 Esri Maps for Salesforce
  • Week of 10/14:               ArcGIS Professional (Esri Germany)
  • Week of 10/21:               Internal Testing
  • Week of 10/28:               Internal Testing

November 2013

  • Week of 11/4:                 Internal Testing
  • Week of 11/11:               Internal Testing
  • Week of 11/18:               Internal Testing
  • Week of 11/25:               OPEN

December 2013

  • Week of 12/2:                 OPEN
  • Week of 12/9:                 OPEN
  • Week of 12/16:               Internal Testing
  • Week of 12/23:               Closed for Holiday
  • Week of 12/30:               Internal Testing

If you would like to participate in a holistic testing session for the next Esri software release, please e-mail holistictesting@esri.com for more information.

Posted in Uncategorized | Leave a comment

Holistic Testing Schedule for Q1/Q2 2013

Here is the current schedule for our events through Q1/Q2 2013.

January 2013

  • Week of 1/7:                 GeoEvent Server for ArcGIS (Washington DC)
  • Week of 1/14:               Internal Testing
  • Week of 1/21:               Esri Maps for Office
  • Week of 1/28:               ArcGIS for Desktop/Server
  • Week of 1/28:               Internal Testing

February 2013

  • Week of 2/4:                 Internal Testing
  • Week of 2/11:               OPEN
  • Week of 2/18:               ArcGIS 10.2 for Desktop/Server
  • Week of 2/25:               ArcGIS 10.2 for Desktop/Server

March 2013

  • Week of 3/4:                 ArcGIS 10.2 for Desktop/Server
  • Week of 3/11:               Internal Testing
  • Week of 3/18:               Localization
  • Week of 3/25:               Software Feedback Island @ the 2013 International Developer Summit

April 2013

  • Week of 4/1:                 Localization
  • Week of 4/8:                 Esri for Sharepoint and Dynamic CRM
  • Week of 4/15:               ArcGIS GeoEvent Processor for Server
  • Week of 4/22:               OPEN
  • Week of 4/29:               OPEN

May 2013

  • Week of 5/6:                 Internal Testing
  • Week of 5/13:               Internal Testing
  • Week of 5/20:               ArcGIS Runtime SDKs – Offline Support
  • Week of 5/27:               ArcGIS Runtime SDKs – Offline Support (Netherlands)
  • Week of 5/27:               Parcel Editing

June 2013

  • Week of 6/3:                 Internal Testing
  • Week of 6/10:               Analysis Online
  • Week of 6/17:               Internal Testing
  • Week of 6/24:               Internal Testing

If you would like to participate in a holistic testing session for the next Esri software release, please e-mail holistictesting@esri.com for more information.

Posted in Uncategorized | Tagged , | Leave a comment

Holistic Testing Schedule for Q3/Q4 2012

Here is the current schedule for our events through Q3/Q4 2012.

July 2012

  • Week of 7/2:               OPEN
  • Week of 7/9:               ArcGIS 64-bit Geoprocessing
  • Week of 7/9:               Windows 8 / Windows 2012
  • Week of 7/16:             Localization
  • Week of 7/23:             Esri International User Conference (Software Feedback Island)
  • Week of 7/30:             ArcGIS with Teradata

August 2012

  • Week of 8/6:               OPEN
  • Week of 8/13:             Internal Testing
  • Week of 8/20:             Internal Testing
  • Week of 8/27:             Internal Testing

September 2012

  • Week of 9/3:               Internal Testing
  • Week of 9/10:             Parcel Editor
  • Week of 9/17:             Flex API
  • Week of 9/24:             Internal Testing

October 2012

  • Week of 10/1:             OPEN
  • Week of 10/8:             Internal Testing
  • Week of 10/15:           ArcGIS Online Templates
  • Week of 10/22:           Native Applications Team Holistic Testing Event
  • Week of 10/29:           Internal Testing

November 2012

  • Week of 11/5:             ArcGIS for Desktop PKI
  • Week of 11/12:           Internal Testing
  • Week of 11/19:           Closed for Holiday
  • Week of 11/26:           Runtime SDKs (Android, iOS, JavaSE & WPF)

December 2012

  • Week of 12/3:             Internal Testing
  • Week of 12/10:           GeoEvent Server for ArcGIS
  • Week of 12/17:           OPEN
  • Week of 12/24:           Closed for Holiday

If you would like to participate in a holistic testing session for the next Esri software release, please e-mail holistictesting@esri.com for more information.

Posted in Uncategorized | Tagged , | Leave a comment

Visit the Software Feedback Island @ the Esri Developer Summit, March 26th – 29th 2012

Stop by the Software Feedback Island at this year’s Esri Developer Summit. We will be located in the Esri Showcase in the Oasis Room on Monday through Thursday. Members of the Esri Holistic Testing team will be available to discuss your comments and feedback on the quality of the ArcGIS software as well as your ideas on how to improve future software releases.

We want to understand your GIS workflows and discuss ways you can become more productive and efficient with your work.  We are interested in how you are using the Esri software across your entire organization to implement your GIS projects for individual tasks or successfully complete entire GIS workflows.  Understanding your workflow is critical for Esri to help test and build better solutions.  Hope to see you there.

Posted in Holistic Testing | Tagged , | Leave a comment

Holistic Testing Schedule for Q1/Q2 2012

We are continuing our test sessions for ArcGIS 10.1 into 2012.  Here is the current schedule for our events through Q1/Q2 2012.

January 2012

  • Week of 1/2: OPEN
  • Week of 1/9: ArcGIS for Windows Mobile v.3.0
  • Week of 1/16: Internal Testing
  • Week of 1/23: Geoprocessing & Analysis
  • Week of 1/30: ArcGIS Server Cloud for Amazon Web Services

February 2012

  • Week of 2/6: ArcGIS SDS
  • Week of 2/13: ArcGIS SP4
  • Week of 2/20: Internal Testing
  • Week of 2/27: Internal Testing

March 2012

  • Week of 3/5: CA-HI-NV Hands on Learning Lab
  • Week of 3/12: Internal Testing
  • Week of 3/19: Localization Testing
  • Week of 3/26: Software Feedback Island @ Esri EPC/Dev Summit

April 2012

  • Week of 4/2: Localization Testing
  • Week of 4/9: ArcGIS Runtime SDK for WPF and Java
  • Week of 4/16: ArcGIS for Windows Mobile v. 3.0
  • Week of 4/23: Internal Testing

May 2012

  • Week of 5/7: Internal Testing
  • Week of 5/14: ArcGIS SP5
  • Week of 5/14: ArcGIS Viewer for Flex v.3.0
  • Week of 5/21: OPEN
  • Week of 5/28: OPEN

June 2012

  • Week of 6/4: OPEN
  • Week of 6/11: OPEN
  • Week of 6/18: Esri Maps for Office
  • Week of 6/25: OPEN

If you would like to participate in a holistic testing session for the next Esri software release, please e-mail holistictesting@esri.com for more information.

Posted in Holistic Testing | Tagged , | Leave a comment

Holistic Testing Program Information

What Is Holistic Testing?
Holistic testing is part of the Esri software development process that tests software releases using real-world workflows and datasets. By implementing user workflows as an integral part of Esri’s software testing strategy, software issues can be identified early and fixed prior to releasing the final product. Throughout the process of discovering software issues based on user workflows, Esri will also gain knowledge and understanding of your GIS workflows and scenarios. This is a path for Esri to capture user requirements and build those requirements into the software to ensure your software needs are met.  

How does it work?
Esri will schedule a holistic testing session based on the changes in the functional areas of the software.  The holistic test team will work directly with a functional development team or an industry manager to identify and coordinate a week of software testing based on feature function or a specific set of workflows for an industry.  The test sessions are scheduled 2-4 months in advance to ensure all logistics can be coordinated, from preparation of the software to be tested to travel and lodging considerations.  Testing participants are invited to Esri Headquarters in Redlands, CA for 5 days of testing.  The holistic team has 2 physical labs where the test sessions will be held.  Each lab is equipped with powerful machines including quad core processors with 8+GB of RAM  that are pre-configured with daily builds of the Esri software including ArcGIS for Desktop, ArcGIS for Server + Business Solution products, and any other 3rd party software required support testing for the week.  These machines are on an internal Esri network managed using a secure Windows network strategy that allows for file sharing between machines and testing participants.

For the week of testing itself, it will kick-off with an opening presentation co-delivered by the functional development lead/industry manager sponsoring the week and holistic team.

This kick-off presentation includes:

  • Introductions
  • Week agenda
  • Lab Resources
    • Software Overview
    • New FeaturesFunctionality in the software
    • FeaturesFunctionality that have changed
    • FeaturesFunctionality that have been remove
    • FeaturesFunctionality that we are interested in being tested
  • How feedback will be collected
  • How to track status of feedback collected

Throughout the week, testers will be supported by the functional development team sponsoring the test week and the holistic test team.  This is done to ensure that an exchange of information regarding technical issues and workflows occurs.  Testing participants will be working alongside the developers who helped create the software that is being tested.  Testing participants will be able to get the clarity needed on how tools are designed and why, so they can be better prepared, in the future, when you move to the latest Esri software release.

Feedback is collected through a web-based system to capture all of the discrete technical issues that are found through the test session.  Additionally, an end of the day wrap-up session is held to discuss all issues captured via the web-based system.  The wrap-up session is held daily, in a group format so all testing participants can hear all feedback, reported from all testers, throughout the testing.  Members of the development team are present to comment on the issues that have been reported.  This is a collaborative environment.  Our expectation is that testing participants will openly discuss the issues they have reported and share their findings with the entire group.  Our development team will ask questions to ensure there is a complete understanding of the issue reported and also ask if other testers have run into the same issue while testing.  This will create a conversational atmosphere where an exchange of process and technique will occur.

When does it occur?
Test sessions will occur weekly throughout the year and the software development cycle.  At certain times in the software development cycle, sessions will be scheduled to validate design decisions and at other times, sessions will be scheduled to ensure the final functionality will meet the needs of the user and is free of critical technical issues.  As Esri evolves in its methods of software development, the testing schedule will change and adapt to meet the needs of the testing requirements.  As more web-based solutions are introduced, test sessions will be held more frequently to ensure we are capturing as much feedback as possible, prior to final release.

Who is involved?
Esri customers, Esri Staff, Esri Business Partners and Esri International Distributors can all be involved in any one or multiple test sessions.  Our mission is to test Esri software products from a user-workflow point of view.  The above mentioned GIS users represent unique communities who have GIS projects with different goals and different deliverables.  We are looking for GIS users who have well-defined workflows, new GIS projects or unique workflows that push the limits of the Esri software.  For any GIS users interested in participating these testing sessions, the holistic team will work with testing participants to understand the focus of the workflow that is to be tested.  We will help to create a test plan for the week of testing to ensure a two-way exchange of information between the testing participants and Esri.  All feedback is valuable to Esri to ensure we are building software that will meet user requirements.  We want to make sure this program provides a mechanism to get that feedback into Esri so we can take an action.

What this means as a testing participant, is that at any test session, the testing participant can be working alongside an Esri staff member, a business partner that the company has worked with in the past, or company in the same industry as the testing participant.

Overall, the lab experience will be collaborative where all testing participants are sharing information and their findings and exchanges ideas for best practice. Testing participants can participate in a testing session in two different ways:

Attending an in-house Holistic Testing event at Esri headquarters in Redlands, California. As mentioned above, the Holistic Testing Lab accommodates users from around the world who use and work with Esri software and functionality that is currently under development.

Remote interaction with members of the Holistic Testing Team from your office. If travel to the Holistic Testing Lab is not possible, you can submit your GIS workflows and datasets to the Holistic Testing Team to test software and functionality for releases that are still in development.  By participating, you will collaborate with a member of the Holistic Team to run through your workflow(s) using the latest software builds and you will receive immediate feedback and validation that your use cases will continue to work when the new release become available.

What is required?
As a testing participant, we do require two things:

We need your Feedback. With each testing session scheduled, we are expecting that testing participants share their feedback.   We are looking for candid feedback on the quality and stability of the software throughout the software development life cycle.  We will use this feedback improve the software prior to final release and document software requirements for future releases.

Signed Holistic Testing Agreement. This is an agreement that describes the holistic testing process, how we are using the feedback, and how you can use any if the information gained from a testing session.

How to get involved?
If you would like to participate in a holistic testing session for the next Esri software release, please email HolisticTesting@esri.com for more information.

Posted in Holistic Testing | Tagged | Leave a comment