You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Because we are using self.start_date and self.end_date, it's causing to assume that other dependency will have same date as current instrument and its data level's date. This becomes an issue since start and end date of dependency could range longer than current processing data.
Download dependency of different start and end date and it's parameters.
Actual behavior (What does happen)
INFO:imap_processing.cli:Processing Swapi level l1
INFO:imap_processing.cli:Beginning preprocessing (download dependencies)
INFO:imap_data_access.io:Querying data archive for {'instrument': 'swapi', 'data_level': 'l0', 'descriptor': 'raw', 'start_date': '20241122', 'end_date': '20241122', 'version': 'v001'} with url https://api.dev.imap-mission.com/query?instrument=swapi&data_level=l0&descriptor=raw&start_date=20241122&end_date=20241122&version=v001
INFO:imap_data_access.io:The file /Users/tech3371/git/imap_processing/data/imap/swapi/l0/2024/11/imap_swapi_l0_raw_20241122_v001.pkts already exists, skipping download
INFO:imap_data_access.io:Querying data archive for {'instrument': 'swapi', 'data_level': 'l1', 'descriptor': 'hk', 'start_date': '20241122', 'end_date': '20241122', 'version': 'v001'} with url https://api.dev.imap-mission.com/query?instrument=swapi&data_level=l1&descriptor=hk&start_date=20241122&end_date=20241122&version=v001
Traceback (most recent call last):
File "/Users/tech3371/Library/Caches/pypoetry/virtualenvs/imap-processing-52JUrpuW-py3.10/bin/imap_cli", line 8, in <module>
sys.exit(main())
File "/Users/tech3371/Library/Caches/pypoetry/virtualenvs/imap-processing-52JUrpuW-py3.10/lib/python3.10/site-packages/imap_processing/cli.py", line 899, in main
instrument.process()
File "/Users/tech3371/Library/Caches/pypoetry/virtualenvs/imap-processing-52JUrpuW-py3.10/lib/python3.10/site-packages/imap_processing/cli.py", line 346, in process
dependencies = self.pre_processing()
File "/Users/tech3371/Library/Caches/pypoetry/virtualenvs/imap-processing-52JUrpuW-py3.10/lib/python3.10/site-packages/imap_processing/cli.py", line 366, in pre_processing
self._dependency_list = self.download_dependencies()
File "/Users/tech3371/Library/Caches/pypoetry/virtualenvs/imap-processing-52JUrpuW-py3.10/lib/python3.10/site-packages/imap_processing/cli.py", line 302, in download_dependencies
raise FileNotFoundError(
FileNotFoundError: File not found for required dependency {'instrument': 'swapi', 'data_level': 'l1', 'descriptor': 'hk', 'version': 'v001', 'start_date': '20240924'} while attempting to create file.This should never occur in normal processing.
Code Snippet:
Code
Additional notes, affected areas, and suggested fixes
No response
The text was updated successfully, but these errors were encountered:
Description of the issue
Because we are using
self.start_date
andself.end_date
, it's causing to assume that other dependency will have same date as current instrument and its data level's date. This becomes an issue since start and end date of dependency could range longer than current processing data.Steps to reproduce the issue
Run this command
imap_cli --instrument swapi --data-level l1 --descriptor sci --start-date 20241122 --version v001 --dependency "[{'instrument': 'swapi', 'data_level': 'l0', 'descriptor': 'raw', 'version': 'v001','start_date': '20241122'}, {'instrument': 'swapi', 'data_level': 'l1', 'descriptor': 'hk', 'version': 'v001','start_date': '20240924'}]"
Expected behavior (What should happen)
Download dependency of different start and end date and it's parameters.
Actual behavior (What does happen)
Code Snippet:
Code
Additional notes, affected areas, and suggested fixes
No response
The text was updated successfully, but these errors were encountered: