Introduction:
On October 12, 2023, a subset of our customers experienced issues with their badges and/or pins not being recognized during authentication requests. This resulted in the inability to authenticate, with the only workaround being to re-register the impacted badges.
Issue Summary:
Impact: A subset of customer instances experienced errors upon login with a badge.
Affected Regions: All regions
Root Cause:
Our in-depth review revealed that a data cleanup script was the source of the issue. Customers who use badges for authentication and rely on specific user attribute data for authentication were impacted due to the data being incorrectly deleted for some of their users during the data cleanup script execution.
Solution and Mitigation:
The Engineering and DevOps teams worked to restore all impacted user badge attribute data and as of October 19, 2023, at 10:41 AM MDT, all known impacted user records had been restored. If any customer observes continuing issues when trying to authenticate with a badge, the impacted badge should be re-registered.
Conclusion:
This issue has been resolved. We have restored all impacted user data and implemented additional testing measures to prevent recurrence.