Model Concurrency Testing

Options
andy_tarr
andy_tarr Member, ALL USERS, Employee Posts: 5 Master Anaplanner of the Year

Assess the 'real world' model performance and scalability

Understand what the customer’s user experience will be at/after go-live by simulating expected real world concurrent user behaviour in customer's model before go-live.

  • Typical daily usage (typical daily number of concurrent users and rate of activity)
  • ‘Black Friday’ periods (elevated level of user concurrency and/or rate of activity during exceptional periods such as month/quarter end)
  • Concurrency growth (model performance impact as the number of concurrent users increases)

What it can do for you:

  • Gain insights into how the model will perform at/after go-live and the level of user concurrency the model can support.
  • Opportunity to make improvements based on the results and demonstrate performance improvements.

How it works

Model Concurrency Team will translate the conurrency requirements into automated tests that accurately simulate real user interactions with the model.

Full process here

Prerequisites:

  • Clear expectation of how users are going to use the model at/after go-live.
  • User Journeys (sequence of user actions) and concurrency scenarios defined (number of users performing each journey and rate that journeys will be completed).
  • Sanitized model and Permission from the data owner to copy the model into the Concurrency Test Environment

Deliverables:

  • Concurrency Test Results
    • Full results
    • Executive Summary