-
Notifications
You must be signed in to change notification settings - Fork 24
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
some invalid data in opensrp database event in profile json object #838
Comments
@imukunzi can we have a call with you to see how this is happening? |
@junaidwarsivd find a screenshot of this issue here |
@imukunzi Please share the queries you are running to flatten the data. |
@dubdabasoduba here are queries ===========symptoms================= ==============physical exam============== |
SELECT id,json->'baseEntityId' as basebaseentityid,json->'eventType' as event_type,btrim(json->'obs'->4->>'values','"[]"') as "hiv_positive",btrim(json->'obs'->10->>'values','"[]"') as "syphilis_positive",btrim(json->'obs'->16->>'values','"[]"') as "hemoglobine",btrim(json->'obs'->17->>'values','"[]"') as "aneamic" from core.event where json->'eventType'='"Tests"' order by id desc; |
Remider to add visit/contact number in event json object. |
hi @imukunzi please apply this querry for the "profile " Please Note : change these trim(both '[""]' from json -> 'obs' -> 2 ->> 'humanReadableValues') as "catchmentarea", updating the rest of the querries as well in this thread cc @AngelaKabari @dubdabasoduba |
@imukunzi please apply this querry for the symptoms : |
@imukunzi please apply this querry for physical exams: SELECT id, |
@imukunzi please apply this querry for TESTS |
@imukunzi please use this querry for the contact/Visit number |
@junaidwarsivd @dubdabasoduba @AngelaKabari |
hi @imukunzi seems like the querries added as a comment got some special characters ignored, you can test the querries from the attached word document requirement for the Contact visit is noted will be updating that in a while |
Hi @junaidwarsivd @AngelaKabari @dubdabasoduba well received, Let me use the queries and I share feedback. |
hi @imukunzi we've gone through adding contact visit number in other events such as profile, tests etc requirement, at this point there are no similar ids that can be related to those events via queries so as a workaround we are going to the add the contact visit number while those events are being generated in the client app, we will be sharing PR as soon as we add Conact Visit attribute in contact json cc @AngelaKabari , @dubdabasoduba |
hi @imukunzi contact number has been added in the events here is the PR for the changes you will be able to find contact_number under details section of the events i've attached the event json sample for the reference
|
Innocent has confirmed that the issue has been satisfactorily resolved and can therefore be closed. |
Affected App or Server Version
v.1.6.10
What kind of support do you need?
There is invalid data in event profile json object, we want to analyze these data, from the excel data captured in March during testing phase hivrisk contains mixed values, These baseEntiryId can help 81341a9d-c91e-4561-a98c-4939ea77164d | a15ed7bc-af7e-435a-af1b-91c63e9178b1 | 56be1ce3-3dc1-46b4-963c-5861ace933f4 We want to use data from database and value need to be harmonized.
==>2022-05-31
There is some invalid data on Symptoms and followup event data for some rows in database we have have number where we are expecting text. On the same shared data baseEntityId 7f3b062a-e622-4485-83a4-1457e6837d7f Physical symptoms column.
What is the acceptance criteria for your support request?
Harmonized profile data
Harmonized Physical Symptoms data
Relevant Information
No response
The text was updated successfully, but these errors were encountered: