[10-10EZ] Update Monitor Documentation #100061
Open
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
coope93
commented
Jan 6, 2025
| - No Action needed, this alert is letting us know that the error rate is back to normal | ||
|
|
||
| ## Slack & Email Alert: "1010EZ Silent Failure on sending submission failure email" |
There was a problem hiding this comment.
Everything above this was autoformatting. This is the new monitor documentation. We can update this as we need to.
hdjustice
reviewed
Jan 6, 2025
|
|
||
| - There should be a corresponding rails log named `Error notification to user failed to deliver` and with metadata containing the notification_id and form id (`{ notification_record_id: notification_record.id, form_number: metadata['form_number'] }`). The form id is `10-10EZ`. | ||
| - Query the database with `VANotify::Notification.find_by(notification_id: notification_id)` to find the failed email address. This email should correspond to a Personal Information Log from roughly 24 hours prior that is created when a 10-10EZ Form fails submission. |
There was a problem hiding this comment.
So if the email address is wrong, we should follow the process to pull Veteran data (name & phone number) that should be sent to HEC.
- Obtain Veteran contact information (Name, Phone number)
- Send the Veteran contact information via secure, encrypted email (from va.gov email address) to [email protected]
- Explain what has happened (submission failure) and provide the Veteran contact info.
- Copy PO (Patrick Bateman) and PMs (Alex Seelig and Heather Justice - VA emails only)
There was a problem hiding this comment.
I added this to the steps 👍
| ## Slack & Email Alert: "1010EZ Silent Failure on sending submission failure email" | ||
|
|
||
| - A 10-10EZ Form submission has failed submission, and the email that is sent to the Veteran has failed sending through VANotify. | ||
| - We should have already seen a `1010EZ submission job has failed with no retries left` failure, and then this monitor would trigger roughly 24 hours later if the email also fails (The email send operation is in a sidekiq job that has 14 retries). |
There was a problem hiding this comment.
Didn't this get updated to 16 retries?
There was a problem hiding this comment.
The VANotify EmailJob does 14 retries, and our 10-10EZ Submission job does 16 retries.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Update 10-10EZ Monitor Documentation for a new monitor for VANotify failures.
Relevant Ticket