Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

OCR Bulk Import Concept #520

Merged
merged 49 commits into from
Aug 28, 2024
Merged

OCR Bulk Import Concept #520

merged 49 commits into from
Aug 28, 2024

Conversation

oakdbca
Copy link
Member

@oakdbca oakdbca commented Aug 28, 2024

  • Merging so PM/BA can do basic demo to business users to get early feedback and inform then of the direction we are trying to take on our end

oakdbca added 30 commits August 15, 2024 09:49
@oakdbca
Add new bulk import component (front end only at this stage).
a76457f
@oakdbca
Add route for new bulk import component.
ee80879
@oakdbca
Add bulk import button above OCR datatable.
57d23d2
@oakdbca
Add OccurrenceReportBulkImportTask.
264d05e
@oakdbca
Add django-filter.
28f8b76
@oakdbca
Add OccurrenceReportBulkImportPermission.
4148ddd
@oakdbca
Add django_filters to INSTALLED_APPS.
7e1fee0
@oakdbca
More work on bulk import feature.
a5559c8
@oakdbca
Remove unused imports.
1e0e34e
@oakdbca
Add OccurrenceReportBulkImportTaskSerializer.
f1ec09a
@oakdbca
Add OccurrenceReportBulkImportTaskViewSet.
fc5df65
@oakdbca
Add basic django admin for OccurrenceReportBulkImportTask.
76bcb63
@oakdbca
Add bulk_import_task foreign key to OCR model (so we can keep track o…
938aa91 
…f those that came from a bulk import task).
@oakdbca
Add occurrence_report_bulk_imports end point.
32b0616
@oakdbca
Register occurrence_report_bulk_imports route.
76ea8fa
@oakdbca
Work on bulk import facility.
3fc6f02
@oakdbca
Fix total_time_taken to return milliseconds. Make OccurrenceReportBul…
ec3a7d4 
…kImportTask model archivable.
@oakdbca
Add end points: occurrence_report_bulk_import_schemas, occurrence_rep…
b639b5f 
…ort_bulk_import_schemas_by_group_type
@oakdbca
Add OccurrenceReportBulkImportSchemaColumnSerializer, OccurrenceRepor…
96de31e 
…tBulkImportSchemaSerializer. Add create method to OccurrenceReportBulkImportTaskSerializer.
@oakdbca
Add basic admin for OccurrenceReportBulkImportSchema.
8562e09
@oakdbca
Register route for OccurrenceReportBulkImportSchemaViewSet.
19f0d0e
@oakdbca
Add OccurrenceReportBulkImportSchemaViewSet. Add revert method to Occ…
2308588 
…urrenceReportBulkImportTaskViewSet.
@oakdbca
Further configuration of bulk import component.
622a6ab
@oakdbca
Migration changes for bulk import models.
135a797
@oakdbca
Add duplicate file contents checking.
6a9ffd4
@oakdbca
Add new component to show list of bulk import schemas.
ce21edf
@oakdbca
Some UI changes.
aaa436d
@oakdbca
Make value returned by total_time_taken_human_readable better. Only c…
d4c7250 
…reate file hash if it hasn't already been created.
@oakdbca
Add route for bulk import schema list component and add bulk_import_s…
4fd3e10 
…chema_id param for the details page.
@oakdbca
Replace health check, scheduler and azcopy installation with new cent…
7f751b7 
…ralised installation script.
oakdbca added 19 commits August 22, 2024 12:07
@oakdbca
get_openpyxl_data_validation_type_for_django_field function.
90722a0
@oakdbca
Add ContentTypeViewSet.
2326938
@oakdbca
Add ContentTypeSerializer.
0e0aec4
@oakdbca
Add content_types end point.
3a8089c
@oakdbca
Update preview_import_file method on OccurrenceReportBulkImportSchema…
92c1ae4 
… model.
@oakdbca
Register route for ContentTypeViewSet.
c3e7a53
@oakdbca
Updates to OccurrenceReportBulkImportSchemaSerializer.
579fea0
@oakdbca
OccurrenceReportBulkImportSchemaViewSet changes: set version for new …
fc40902 
…schema in perform_create method. Add custom actions for copy and save_column.
@oakdbca
Add features for copying and creating new schemas.
c3a84b8
@oakdbca
Update pre-commit.
b92c92c
@oakdbca
Allow updates on OccurrenceReportBulkImportSchemaViewSet.
704b236
@oakdbca
Add more data to filter_fields field on ContentTypeSerializer.
4452130
@oakdbca
Add update method to OccurrenceReportBulkImportSchemaSerializer.
9e49399
@oakdbca
Comment fix.
f0b948c
@oakdbca
Minor change to sample help text.
0a0d635
@oakdbca
Return None for validation type for foreign keys instead of list for …
ab159ef 
…now (May consider adding embedded list validation for foreign keys that are a basic lookup and only have say 30? or list items to choose from.
@oakdbca
Further work configuring the component.
ab65caa
@oakdbca
Merge branch 'ocr-bulk-import'
115bb58
@oakdbca
Merge migrations.
67ea692
xzzy
xzzy approved these changes Aug 28, 2024
View reviewed changes
Copy link
Collaborator

@xzzy xzzy left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sensitivity Check Completed

@xzzy xzzy merged commit 6ccc604 into dbca-wa:main Aug 28, 2024
9 of 11 checks passed
@sentry-io Sentry.io
Copy link

sentry-io bot commented Aug 29, 2024 •
edited
Loading

Suspect Issues

This pull request was deployed and Sentry observed the following issues:

  • ‼️ AttributeError: 'NoneType' object has no attribute 'version' /api/occurrence_report_bulk_import_schemas/ View Issue
  • ‼️ NameError: name 'rderedModel' is not defined boranga.components.occurrence.models in Occurre... View Issue

Did you find this useful? React with a 👍 or 👎

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@xzzy xzzy xzzy approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@oakdbca @xzzy