A Year In Review: Accessibility Success at U.S. Bank axe-con 2021 March 10, 2021 Matthew Luken, Director UXDesign Digital A11Y Derrin Evers, Assoc. Director UXDesign Digital A11Y U.S. BANK Public 1
April 2018 December 2018 Concepting / Testing Let s quickly set the stage: org change moved A11Y team from Digital Operations to UXDesign 2 contractors + immediate addition of 2 FTE + 1 IT/TOS Primarily focused on dot com website and main mobile app Bank rapidly morphing to agile methodologies UXDesign starting to shift to user centric / design first approaches Superbowl hosted in Minneapolis at U.S. Bank Stadium Investment in 13 dedicated agile teams 6 teams dedicated to mobile app redesign / rebuild A11Y Policy solidly states net-new development meets WCAG20AA Deque per-seat licenses purchased as a proof of concept Attest / DevTools + Assure / Auditor + University Team grows to include A11Y consultants within the agile UXDesign teams now at 7 UXDesign A11Y + 1 IT/TOS U.S. BANK Public 2
January 2019 December 2019 Foundation Setting Continue into 2019: Feb 2019 Deque Professional Services deployed to manually test 10% sample of mobile app prior to launch Anecdotal findings show approach + tools has positive results Deque tools POC extended to Online Banking (website) project Summer 2019 business case made for enterprise licenses Move to org-agnostic approach w/ ABO + IT/TOS + Risk + DigA11Y Fall 2019 A11Y team creates all tools, processes, artifacts, project plans, etc. for 2020 rollout of Deque tools and grows by 2 more Dec 10, 2019 Enterprise agreement funded / approved for all three (3) tools Dec 13, 2019 aggressive goal established to add fifty (50) agile teams using common A11Y tools, processes and measurements. U.S. BANK Public 3
January 6, 2020 January 8, 2021 Rapid Expansion Since Jan 6, 2020 we have seen phenomenal growth in shifting left From 8 teams to 190 teams 2,375% growth 364% over plan Deque University: 2,505 active users 275 users to 2,505 users DevTools: 2,093 licensed users 50 users to 2,093 users Auditor: 759 licensed users 21 users to 759 users U.S. BANK Public 4
2020 Industry Recognition From Diversity Inc. In 2019 we broke into the top 50 for the first time! In May 2020 we learned. Our work has been directly correlated to moving into position #13 of Diversity Inc. s "top companies for people with disabilities" list. Press American Banker article on inclusive consumer collaboration Inclusive Testing article with Forrester Numerous Internal Corp Comm features Cross-networking opportunities within the Corporation U.S. BANK Public 5
2020 Team Growth The team has grown exponentially - 275% Plus, tools are being used in all subsidiaries worldwide. January 20 December 20 UXD IT/TOS 9 3 UXD IT/TOS 29 4 U.S. BANK Public 6
In 2020, we moved from Reactive A11Y to Proactive A11Y Our New Path Forward Let s look closer at how we did it! U.S. BANK Public 7
Enterprise Deque A11Y Tool Rollout Plan 2020 1. Agile team by agile team rollout approach. Rollout is tied to the PI-cycle. 2. Orientation focuses on tool setup, University training, and adjustments of team to the Proactive model. 3. Teams run Deque tools in a Guided Trial prior to Definition of Done (DoD) Adherence. 4. In DoD, JIRA stories should not advance without attestation. U.S. BANK Public 8
Roadshow Objectives The presentation will help us align on our collective path toward digital accessibility. Discuss as a team how you ensure Digital Accessibility. This presentation is a guide to you / your team s A11Y discussion(s): Know how the bank focuses on accessibility. Explore what is meant by disability and accessibility guidelines. Review key accessibility components at the bank. Understand the value stream and that everyone has a role in accessibility. Identify tools and support for accessibility work. Understand the new way forward as we change from Reactive to Proactive Accessibility. U.S. BANK Public 9
Communicate how A11Y ties directly to U.S. Bank s Core Values OUR PURPOSE is our reason for being OUR CORE VALUES are the beliefs that guide what we do We invest our hearts and minds to power human potential. We do the right thing. We power potential. We stay a step ahead. We draw strength from diversity. We put people first. OUR STRATEGY is how we will grow; it comes to life by activating our pillars: by being the most trusted choice, driving one U.S. Bank, striving for simplicity and creating the future now. The pillars are activated horizontally (initiatives that run across our organization) and vertically (initiatives that run within our revenue lines to facilitate growth). U.S. BANK Public 10
Affecting reduction in defects Shift Left! Affecting A11Y during the design phase has a 67% reduction in defects at automated testing phase. 67% Reduction of defects when A11Y considered in design Data source: http://www-01.ibm.com/support/docview.wss?uid=swg27048410&aid=1 U.S. BANK Public 11
Roles and Tools Matrix Everyone contributes! U.S. BANK Public 12
A11Y Value Stream Process with Tools and Proof for Internal Audit Designing products that are accessible from the beginning requires a new, more collaborative process. U.S. BANK Public 13
Late 3rd Quarter 2020, we started focusing on Maturing Teams In-Flight while continuing to add more agile teams Maturity focuses on quality U.S. BANK Public 14
What started as vendor validation lead to compelling quality focus Tool Comparison - Violations Found Tool Axe Attest / DevTools Assure / Auditor Issues (Manual) Issues (Auto) Total Issues N/A 21 21 N/A 21 21 9 21 30 Custom 5 N/A 5 Deque s Assure / Auditor method found 600% more issues than custom testing methodology. Additionally Assure s / Auditor s automated testing uncovered 21 issues instantly Assure s / Auditor s issue description library provided consistent details across issues Assure / Auditor s automatically cross referenced Deque University to provide further information for troubleshooting U.S. BANK Public 15
A11Y Value Stream Process with Tools and Proof for Internal Audit Deque s Assure / Auditor versus Thorough WCAG coverage Future WCAG updates handled by Deque Consistent testing methods and reporting across teams Automated A11Y testing integration (web only) Cross integration with resource repository (E.g. DQU) U.S. BANK Public 16
A11Y Value Stream Process with Tools and Proof for Internal Audit versus Custom Testing Strategy Thorough WCAG coverage Future WCAG updates handled by Deque Consistent testing methods and reporting across teams Automated A11Y testing integration (web only) Cross integration with resource repository (E.g. DQU) U.S. BANK Public 17
As we focused on quality, we ve accomplished a lot more in addition, we have Reduced Time allowing fixes to be worked on quicker Automated the defect creation process which means consistent defects for developers that are consistently written, formatted and advises how to fix the issue. Increased Training & Research Capabilities With Deque University we now have GLL-like training in addition to a searchable repository of information allowing developers to research prior to solution design. Improved Quality of Workmanship Thru Deque s DevTools and University we are starting to see reduction in repeat errors. Reduced Manual Testing Time (in some cases) Improved WCAG Compliance Testing Accuracy as we saw 2 slides ago: Team thought they had 5 violations they had 30 total Capability to reduce False Positives U.S. BANK Public 18
2021 sees us focusing on morphing to the next phase of the Master Plan U.S. BANK Public 19
2021 s Focus Moving forward we focus on: CONTINUE: rolling out tools to more digital product teams CONTINUE: improving quality & maturity of each team CONTINUE: perfecting our UXDesign engagements CONTINUE: Using tools to stop hemorrhaging A11Y defects into production CONTINUE: changing the UXDesign A11Y Consultants role to include overall A11Y Health of a digital product CONTINUE: morphing to outcome-based engagements with teams START: Implementing Deque s Monitor for websites to provide product owners with real data about current in-product defects (purchased Dec 2020) START: building road maps to remediate existing technical debt / non-compliant digital products to meet regulation / target dates U.S. BANK Public 20
QUESTION & ANSWER A Year In Review: Accessibility Success at U.S. Bank axe-con 2021 March 10, 2021 Matthew Luken, Director UXDesign Digital A11Y Derrin Evers, Assoc. Director UXDesign Digital A11Y U.S. BANK Public 21