Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Anomalizer #14

Draft
wants to merge 90 commits into
base: master
Choose a base branch
from
Draft
Show file tree
Hide file tree
Changes from 84 commits
Commits
Show all changes
90 commits
Select commit Hold shift + click to select a range
97d8e43
Add basic documentation
Oct 19, 2018
b27c9ab
Update changes
Oct 19, 2018
76540cc
Add parse for file name parsing
Oct 19, 2018
c3a5d73
Reshuffle without passed parameters, update test
Oct 19, 2018
0d6753c
Fix typo
wpreimes Oct 19, 2018
ca95244
Fix import statements
Oct 19, 2018
063f917
Merge branch 'develop' of github.com:wpreimes/c3s_sm into develop
Oct 19, 2018
6c97837
Fix python 3 issue with dict keys not a list
Oct 19, 2018
cd84caf
Test with python 3.6 instead of 3.4
wpreimes Oct 19, 2018
092893d
Update .travis.yml
wpreimes Oct 19, 2018
f5ca6f1
Update test-requirements.txt
wpreimes Oct 22, 2018
c8e2ab9
Merge pull request #1 from wpreimes/develop
wpreimes Oct 22, 2018
f5d66e2
Update setup and requirements
Oct 22, 2018
240cbbe
Merge pull request #1 from wpreimes/master
wpreimes Oct 22, 2018
44cc7e6
Docu and CI update (#2)
wpreimes Oct 30, 2018
1bde75b
Update LICENSE.txt
tracyscanlon Nov 12, 2018
b47bf74
removal of latex docs, manual and textinfo docs
tracyscanlon Nov 12, 2018
995d139
removal of unicode text in conf.py
tracyscanlon Nov 12, 2018
0540490
removed python 3 requirement from readthedocs.yml
tracyscanlon Nov 12, 2018
85cc3af
deleted doc_requirements and readthedocs.yml
tracyscanlon Nov 12, 2018
8a94700
updated so same as esa_cci_sm docs makefile (build working)
tracyscanlon Nov 12, 2018
29a72ea
Update path to submodule
wpreimes Nov 15, 2018
f2d46d5
Fix docu and change submodule path (#3)
wpreimes Nov 15, 2018
5f82429
Fix coveralls (#4)
wpreimes Nov 20, 2018
5e20167
Update requirements (#5)
wpreimes Nov 20, 2018
1100c22
Implement smecv-grid (#6)
wpreimes Nov 21, 2018
e1fa531
Update README.rst
wpreimes Nov 21, 2018
f9da1a1
Fix docs requirements file name
wpreimes Nov 21, 2018
16cd0a3
Merge pull request #7 from wpreimes/develop
wpreimes Nov 21, 2018
d4f6e6d
Update varnames.rst
wpreimes Nov 22, 2018
51b37f3
Update requirements and CI
wpreimes Jan 21, 2019
d859a15
Update tests
wpreimes Jan 21, 2019
d56b0fe
Update TS reader class
wpreimes Jan 21, 2019
69278c3
Fix reshuffle issue when using masked arrays from grid
wpreimes Jan 21, 2019
e959583
Update documentation
wpreimes Jan 21, 2019
8068ddb
Fix python version checking
wpreimes Jan 21, 2019
e6b27d4
Remove test code
wpreimes Jan 21, 2019
331be98
Update miniconda
wpreimes Jan 21, 2019
e6ab874
Change installation order
wpreimes Jan 21, 2019
bd6ddd2
Update if statement
wpreimes Jan 21, 2019
de9741f
Update travis
wpreimes Jan 21, 2019
b782214
Update travis
wpreimes Jan 21, 2019
1307900
Update .travis.yml
wpreimes Jan 21, 2019
c029500
Update reader description
wpreimes Jan 21, 2019
0f32c70
Merge pull request #8 from wpreimes/develop
wpreimes Jan 21, 2019
9a78619
Removed submodule
wpreimes Jan 25, 2019
a1c2c5d
Update test data module
wpreimes Jan 25, 2019
ca0222a
Add more_itertools to requirements
wpreimes Feb 21, 2019
f814bca
Merge pull request #9 from wpreimes/develop
wpreimes Feb 21, 2019
b86957b
added use case for calculating anomalies for 5 locations
Mar 7, 2019
638371c
Updated table in use case for fifth location
Jun 17, 2019
a62bb79
travis config updated for newer python versions
Jun 17, 2019
ee6f8be
Update travis.yml
wpreimes Aug 14, 2019
b94ebe9
Merge pull request #10 from wpreimes/develop
wpreimes Aug 15, 2019
9f7bd38
Update pyscaffold structure
wpreimes Jul 3, 2020
0a17ec0
Update package structure
wpreimes Jul 3, 2020
adf07c0
Update gitmodules
wpreimes Jul 3, 2020
8909cd1
Add option to drop TZ
wpreimes Jul 3, 2020
1694724
Update .readthedocs.yml
wpreimes Jul 3, 2020
823b6d3
Add readthedocs requirements
wpreimes Jul 3, 2020
8314cf5
Add check for pandas datetime index
wpreimes Jul 3, 2020
f2edc31
Change docs html template
wpreimes Jul 3, 2020
b61ee47
Merge pull request #12 from wpreimes/develop
wpreimes Jul 3, 2020
793b3e5
Update changelog
wpreimes Jul 3, 2020
8fce278
Merge remote-tracking branch 'upstream/master' into develop
wpreimes Jul 3, 2020
687c866
Update bitflags
wpreimes Dec 14, 2020
6eb2600
Add v201912
wpreimes Dec 14, 2020
d4f1292
Fill with NaN
wpreimes Dec 14, 2020
93e881a
Revert
wpreimes Dec 14, 2020
a279fa6
Update to combine icdr and cdr
wpreimes Feb 7, 2021
d7a6c26
Add datacube class
wpreimes Feb 22, 2021
852b49f
Update data cube reading
wpreimes Feb 22, 2021
b3772ef
Update image reading
wpreimes Feb 23, 2021
073f646
Update subset reading
wpreimes Feb 23, 2021
474af01
Update image reader and tests
wpreimes Feb 24, 2021
75bc036
Fix reshuffle and tests
wpreimes Feb 24, 2021
5142594
Update reshuffle and docs
wpreimes Feb 28, 2021
1211cf3
Update readers, tests and package structure
wpreimes Mar 4, 2021
1f54133
Add workflows
wpreimes Mar 4, 2021
d46327b
Rename folder
wpreimes Mar 4, 2021
0d2a0ff
Update ci and environemnt
wpreimes Mar 4, 2021
785f360
Update changelog
wpreimes Mar 4, 2021
4e5d969
remove xarray datacube class for now
wpreimes Mar 4, 2021
3ea40c1
Update testdata module
wpreimes Mar 4, 2021
f231e60
Fix testdata pointer
wpreimes Mar 4, 2021
85d051c
Sort files
wpreimes Mar 4, 2021
83b8c83
Merge pull request #13 from wpreimes/master
wpreimes Mar 4, 2021
6f0c11a
Anomaly calculation and repurposing for C3S
pstradio Feb 8, 2022
b646a1d
improved documentation
pstradio Apr 14, 2022
aba7637
solved conflicts
pstradio Apr 14, 2022
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
23 changes: 23 additions & 0 deletions .coveragerc
Original file line number Diff line number Diff line change
@@ -0,0 +1,23 @@
# .coveragerc to control coverage.py
[run]
branch = True
source = c3s_sm
omit = */_version.py

[report]
# Regexes for lines to exclude from consideration
exclude_lines =
# Have to re-enable the standard pragma
pragma: no cover

# Don't complain about missing debug-only code:
def __repr__
if self\.debug

# Don't complain if tests don't hit defensive assertion code:
raise AssertionError
raise NotImplementedError

# Don't complain if non-runnable code isn't run:
if 0:
if __name__ == .__main__.:
1 change: 1 addition & 0 deletions .gitattributes
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
c3s_sm/_version.py export-subst
84 changes: 84 additions & 0 deletions .github/workflows/ci.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,84 @@
# This workflow will install Python dependencies and run tests on
# windows and linux systems with a variety of Python versions

# For more information see:
# https://help.github.com/actions/language-and-framework-guides/using-python-with-github-actions

name: tests

on:
push:
pull_request:
schedule:
- cron: '0 0 * * *' # daily

jobs:
build:
name: Build py${{ matrix.python-version }} @ ${{ matrix.os }} 🐍
runs-on: ${{ matrix.os }}
strategy:
matrix:
python-version: ['3.6', '3.7', '3.8']
os: ["ubuntu-latest", "windows-latest"]

steps:
- uses: actions/checkout@v2
with:
submodules: false # does not work with self-hosted testdata
- name: Checkout Testdata
shell: bash -l {0}
run : |
git submodule init
git submodule update
ls tests/c3s_sm-test-data
- uses: conda-incubator/[email protected]
with:
miniconda-version: "latest"
auto-update-conda: true
python-version: ${{ matrix.python-version }}
environment-file: environment.yml
activate-environment: c3s_sm
auto-activate-base: false
- name: Print environment infos
shell: bash -l {0}
run: |
conda info -a
conda list
pip list
which pip
which python
- name: Export Environment
shell: bash -l {0}
run: |
mkdir -p .artifacts
filename=env_py${{ matrix.python-version }}_${{ matrix.os }}.yml
conda env export --no-builds | grep -v "prefix" > .artifacts/$filename
- name: Upload Artifacts
uses: actions/upload-artifact@v2
with:
name: os_py_environments
path: .artifacts/*
- name: Install package and test
shell: bash -l {0}
run: |
pip install .
python setup.py test
- name: Upload Coverage
shell: bash -l {0}
run: |
pip install coveralls && coveralls --service=github
env:
GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}
COVERALLS_FLAG_NAME: ${{ matrix.python-version }}
COVERALLS_PARALLEL: true
coveralls:
name: Submit Coveralls 👚
needs: build
runs-on: ubuntu-latest
container: python:3-slim
steps:
- name: Finished
run: |
pip3 install --upgrade coveralls && coveralls --service=github --finish
env:
GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}
41 changes: 41 additions & 0 deletions .github/workflows/pypi_release.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,41 @@
name: pypi

# This workflow uploads a release to pypi. A released must be triggered
# via github (releases) and will include a version number tag (leading 'v'!!)
# This will NOT repeat testing, draft a release only from tested branches!

on:
release:
types: [released] # only on tagged github RELEASE, (a simple tag is not enough!)

jobs:
publish:
name: Upload to Pypi 🚀
# needs original account (TUW-GEO) and tagged github RELEASE (tag: v*),
# safety measure to not release normal tags and/or releases in forks
if: startsWith(${{ github.ref }}, 'refs/tags/v') && startsWith(${{ github.repository }}, "TUW-GEO/")
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@v2
with:
repository: ${{ github.repository }}
ref: ${{ github.ref }}
- name: Set up Python
uses: actions/setup-python@v2
with:
python-version: 3.x
- name: Build
shell: bash -l {0}
run: |
python setup.py --version
python setup.py sdist
pip install wheel && python setup.py bdist_wheel
- name: Publish distribution to PyPI
uses: pypa/[email protected]
with:
skip_existing: true
verbose: true
verify_metadata: true
packages_dir: dist/
user: __token__
password: ${{ secrets.PYPI_API_TOKEN }} # todo: add token to github actions secrets
2 changes: 2 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -40,3 +40,5 @@ docs/api/*
docs/_build/*
cover/*
MANIFEST

*/_local_scripts/*
13 changes: 4 additions & 9 deletions .gitmodules
Original file line number Diff line number Diff line change
@@ -1,9 +1,4 @@
[submodule "tests/test-data/c3s_sm"]
path = tests/test-data/c3s_sm
url = https://github.com/TUW-GEO/c3s_sm
[submodule "tests/test-data/c3s_sm-test-data"]
path = tests/test-data/c3s_sm-test-data
url = https://github.com/TUW-GEO/c3s_sm-test-data
[submodule "tests/test-data"]
path = tests/test-data
url = https://github.com/TUW-GEO/c3s_sm-test-data
[submodule "tests/c3s_sm-test-data"]
path = tests/c3s_sm-test-data
url = https://www.geo.tuwien.ac.at/downloads/gittd/c3s_sm-test-data.git/
ignore = dirty
12 changes: 12 additions & 0 deletions .readthedocs.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,12 @@
version: 2

sphinx:
configuration: docs/conf.py

formats:
- pdf

python:
version: 3.7
install:
- requirements: docs/requirements.txt
49 changes: 0 additions & 49 deletions .travis.yml

This file was deleted.

3 changes: 2 additions & 1 deletion AUTHORS.rst
Original file line number Diff line number Diff line change
Expand Up @@ -2,4 +2,5 @@
Developers
==========

* tscanlon <[email protected]>
* Tracy Scanlon <[email protected]>
* Wolfgang Preimesberger <[email protected]>
32 changes: 32 additions & 0 deletions CHANGELOG.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,32 @@
=========
Changelog
=========

Version 0.X (unreleased)
========================

- Allow reading and reshuffling spatial subsets (bbox)
- Add support for new versions v201912, v202012
- Add module to generate metadata for time series files

Version 0.1.2
=============

- Update pyscaffold structure
- Add automatic pypi deploy
- Add option to remove time zone info from time series

Version 0.1.1
=============

- Contains extended time series reader

Version 0.1
===========

- Add smecv grid support
- Add reader from images and image stacks
- Add reshuffle module
- Add first version of metadata module
- Add basic documentation
- Add unit tests for all modules
10 changes: 0 additions & 10 deletions CHANGES.rst

This file was deleted.

22 changes: 21 additions & 1 deletion LICENSE.txt
Original file line number Diff line number Diff line change
@@ -1 +1,21 @@
Copyright 2018 tscanlon
The MIT License (MIT)

Copyright (c) 2018 TU Wien

Permission is hereby granted, free of charge, to any person obtaining a copy
of this software and associated documentation files (the "Software"), to deal
in the Software without restriction, including without limitation the rights
to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
copies of the Software, and to permit persons to whom the Software is
furnished to do so, subject to the following conditions:

The above copyright notice and this permission notice shall be included in all
copies or substantial portions of the Software.

THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
SOFTWARE.
3 changes: 3 additions & 0 deletions README.rst
Original file line number Diff line number Diff line change
Expand Up @@ -9,6 +9,9 @@ c3s_sm
.. image:: https://coveralls.io/repos/github/TUW-GEO/c3s_sm/badge.svg?branch=master
:target: https://coveralls.io/github/TUW-GEO/c3s_sm?branch=master

.. image:: https://badge.fury.io/py/c3s-sm.svg
:target: https://badge.fury.io/py/c3s-sm

.. image:: https://readthedocs.org/projects/c3s_sm/badge/?version=latest
:target: http://c3s_sm.readthedocs.io/en/latest/?badge=latest

Expand Down
7 changes: 0 additions & 7 deletions c3s_sm/__init__.py

This file was deleted.

Loading