-
Notifications
You must be signed in to change notification settings - Fork 11
Add CEM #512
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Draft
erialC-P
wants to merge
109
commits into
main
Choose a base branch
from
add_CEM
base: main
Could not load branches
Branch not found: {{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
Draft
Add CEM #512
Changes from all commits
Commits
Show all changes
109 commits
Select commit
Hold shift + click to select a range
f261568
add starter_kit to new CEM product folder
erialC-P 9118657
link product to KH sidebar and product category
erialC-P 61ebba0
updating starter kit link to KH metadata field doco
erialC-P bcde216
draft 'About' section
erialC-P 264c081
add Mitch's draft to Quality tab
erialC-P 79f1c7a
add drafted text
erialC-P 8697897
reformat dot points
erialC-P bba5c84
add band specific metadata
erialC-P 5aad58b
replaced bands_table with layers_table
erialC-P be2b264
Replace as band table and reformat code
erialC-P 2c523ab
Updated Ecosystem definitions section
erialC-P c6db3dd
_data.yaml updates
erialC-P 38e2919
reformat
erialC-P bbbf8a6
fix typo
erialC-P bf75a7b
reformat _tables.yaml to match DEA_Intertidal
erialC-P 36b227f
rename directory
erialC-P 96919ae
syntax change
erialC-P e55e359
test DEA Intertidal _tables.yaml
erialC-P a6c0596
Explore preview build error AttributeError: 'NoneType' object has no …
erialC-P 0654be1
update
erialC-P 23819db
Git pull and add figures
erialC-P 74e88ef
fix nodata value in coastal-connectivity
erialC-P dda59d3
fix directory typo's
erialC-P d127dcc
recommit files after directory name change
erialC-P 10637f0
update directory names
erialC-P b5e6624
direct theme to correct directory
erialC-P e50b5dd
exploring why PR Preview pointing to old directory name in 'Theme' me…
erialC-P 7ea6f85
create new product folder
erialC-P b003724
minor edits
erialC-P f2f7346
Left align doc text by closing figure calls using myst syntax
erialC-P 5d20696
added covariate data table
erialC-P 39b38a8
Connectivity figure and update
erialC-P b9fe40d
add figures update links
erialC-P ca40f94
Fix typo's
erialC-P dceaf5d
Update references
erialC-P d10bc38
add figures, update links
erialC-P 4f4f552
plot two figures together using myst syntax
erialC-P 3965ad3
draft Software section
erialC-P 63187c1
fix figures using myst syntax
erialC-P 9db13d8
try to fix myst syntax
erialC-P 71a77af
Full review
erialC-P 77ada7c
remove old broken directory for CEM
erialC-P faa005e
add dropdown menus to processing steps
erialC-P d49a2e9
reworked dropdown menus
erialC-P 69a1d3e
reformat dropdowns
erialC-P d017d3e
rejig workflow section
erialC-P 2df69de
add CEM to COG user guide
erialC-P fbf910c
Update overview, add manual_mask link
erialC-P 70dafb3
add seagrass feature importance graph
erialC-P 9b74402
added caveats and linitations
stevesagar f7ae0bf
formatting Caveats
stevesagar b62a22b
formatting
stevesagar 2c52630
Access placeholders from Intertidal
stevesagar d6d6e45
link to Intertidal tidal bias
stevesagar 9820b9f
try tide bias link again...
stevesagar 1817be7
fix typos
erialC-P cc049de
Overview and Product Title
stevesagar 84c0fcd
replace flowchart
erialC-P 42af0f1
overview intertidal
stevesagar c2a698d
replace ML feature importance and update covariates section
erialC-P 7cf5125
update ML section with Mitch's comments
erialC-P 7377176
replace probabilities figure
erialC-P cb4488b
CEM name changes, links and year removals. History and data.yaml init…
stevesagar 4546959
fix links
stevesagar e2dfc66
credits access tidy up
stevesagar f3dfb5a
spelling
stevesagar d5d0767
Replace covariate feature importance graph
erialC-P 2dc8241
Update product name at theme level
erialC-P 5ddcd4b
fix typos
erialC-P 32c1dcf
typos
erialC-P e5c9510
typos
erialC-P b1f6b62
updates and typos
erialC-P fb0f7d5
Update validation results
erialC-P f076a70
Thumbnail image to reduce download size
benji-glitsos-ga 6e9b6aa
Fixing data YAML
benji-glitsos-ga d0d6550
DOI and eCat
benji-glitsos-ga 2b9b330
Access AWS data link
benji-glitsos-ga 72e3336
Bands edit
benji-glitsos-ga 674dfaf
History formatting
benji-glitsos-ga 42c17d0
Description layer headings
benji-glitsos-ga 53cdda0
Dropdown syntax
benji-glitsos-ga 9bc1624
Split a dropdown into two
benji-glitsos-ga 4d1995b
Quality tab minor formatting
benji-glitsos-ga 150a506
Converted absolute to relative links plus fixed one syntax issue of a…
benji-glitsos-ga 27099bf
Changed URL from dea-coastalecosystems to dea-coastal-ecosystems
benji-glitsos-ga c2fa06f
Thumbnail needed to be bigger
benji-glitsos-ga ceb39d0
Listed the parent products
benji-glitsos-ga 20e7f4e
GitHub custom access link
benji-glitsos-ga fa2f3aa
Minor text edit
benji-glitsos-ga 1528ba8
Minor edits to Description
benji-glitsos-ga 18d4cd4
Minor edits to Description
benji-glitsos-ga f5bff3b
Minor edits to Description
benji-glitsos-ga 9397285
Minor edits to Description
benji-glitsos-ga 746a6f9
Minor edits to Quality
benji-glitsos-ga 6cc45d9
Minor edits to Access
benji-glitsos-ga d2835ae
Minor edits to Credits
benji-glitsos-ga 0f00fee
Fixed important error in filename and ensured em-dashes consistency
benji-glitsos-ga ca09306
Greater-than operator consistency
benji-glitsos-ga 576faa5
data YAML minor edits
benji-glitsos-ga ffdcff4
Redirect for the old URL
benji-glitsos-ga 9fc51f9
typo
benji-glitsos-ga 0f36089
Adding non-ongoing to data update in template
benji-glitsos-ga 7b28f49
Fixing template
benji-glitsos-ga ac9555f
Increase thumbnail resolution
benji-glitsos-ga 36d9abe
Minor change to template - data updates
benji-glitsos-ga 8d27490
Updated links from current Github to S3. Removed refs to Github in So…
stevesagar d86c85d
fix remaining links remove source code access link
stevesagar 676f688
Added data citation
benji-glitsos-ga 984c21a
updated specifications
erialC-P File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added
BIN
+269 KB
docs/_files/dea-coastalecosystems/Original_training_point_distribution.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added
BIN
+1.05 MB
docs/_files/dea-coastalecosystems/classification_Shoalwater_2021_thumbnail.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added
BIN
+17.6 MB
docs/_files/dea-coastalecosystems/classification_bermagui_2021_LTC.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added
BIN
+3.45 MB
docs/_files/dea-coastalecosystems/low_tide_composite_2021_bermagui.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,46 @@ | ||
| % See the Product metadata fields documentation: https://docs.dev.dea.ga.gov.au/services/dea-knowledge-hub/operating-procedures/product-metadata-fields/#kh-product-metadata-fields | ||
|
|
||
| :::{admonition} Streaming data from AWS is strongly recommended | ||
| :class: note | ||
|
|
||
| DEA Coastal Ecosytems data is large with files up to 3 GB in size. We strongly recommend streaming data directly from the cloud rather than downloading the data. Please see the instructions below: **How to stream data from AWS** | ||
| ::: | ||
|
|
||
| :::{dropdown} How to explore DEA Maps (To be completed with StoryMap) | ||
|
|
||
| Start exploring [DEA Coastal Ecosystems on DEA Maps](https://maps.dea.ga.gov.au/story/DEACoastalEcosystems). | ||
|
|
||
| To add DEA Coastal Ecosystems to DEA Maps manually: | ||
|
|
||
| 1. Open [DEA Maps](https://maps.dea.ga.gov.au/). | ||
| 1. Select **Explore map data** on the top-left. | ||
| 1. Select **Sea, ocean and coast** > **DEA Coastal Ecosystems** > **DEA Coastal Ecosystems (Sentinel-2)**. | ||
| 1. Click the **Add to the map** button on top-right. | ||
|
|
||
| View the product layer required by selecting the layer from the **Styles** dropdown menu, and use the **Time** selector to view the annual time-series of each product layer. | ||
|
|
||
| % TODO To query an absolute value for any of the product layers, click on a location to see a plain text summary of all the DEA Intertidal product suite data values at that pixel location. | ||
| ::: | ||
|
|
||
| :::{dropdown} How to stream data from AWS (Recommended) | ||
|
|
||
| The easiest way to access DEA Coastal Ecosystems data is via our continental-scale cloud-optimised GeoTIFF mosaics (COGs). | ||
| The COG file format is a type of GeoTIFF raster file (`.tif`) that allows you to quickly and efficiently 'stream' data directly from the Amazon S3 cloud without having to download files to your computer. | ||
| This allows you to rapidly access data from the entire Australian continent without having to download large files. | ||
|
|
||
| VRT (Virtual Raster) files are also provided alongside the mosaics. These files serve as lightweight wrappers around the main data and can be used to open data in GIS software with visual settings already applied. | ||
|
|
||
| Learn more about [Continental Cloud-Optimised GeoTIFF Mosaics](/guides/continental-cogs-geotiff-mosaics/). | ||
|
|
||
| ::: | ||
|
|
||
|
|
||
| :::{dropdown} How to download Continental Mosaic data | ||
|
|
||
|
|
||
|
|
||
| 1. Open the [DEA Coastal Ecosystems](https://data.dea.ga.gov.au/?prefix=derivative/ga_s2_coastalecosystems_cyear_3_v1/AU/) directory in DEA's Amazon S3 bucket: | ||
| 1. Enter a directory of a particular year, e.g. `2021--P1Y` | ||
| 1. Click to download the product layer of interest, e.g. `ga_s2_coastalecosystems_cyear_3_v1-0-0_AU_2021-P1Y_final_classification.tif`. Learn more about file naming and product layers: [Technical Information](./?tab=description#core-product-layers). | ||
| ::: | ||
|
|
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,17 @@ | ||
| % See the Product metadata fields documentation: https://docs.dev.dea.ga.gov.au/public_services/dea_knowledge_hub/product_metadata_fields.html | ||
|
|
||
| ## Acknowledgments | ||
|
|
||
| The authors would like to sincerely thank our collaborators on this project from James Cook University and the University of New South Wales, in particular Mitchell Lyons, Nicholas Murray, Alex Navarro and Robert Canto. | ||
|
|
||
| We also like to acknowledge contributions and feedback from various academic institutions through the course of this product development, in particular from the teams at the Universities of Newcastle (Chris Owers and Rafael Carvalho) and Wollongong (Jeff Kelleway). | ||
|
|
||
| Numerous Commonwealth, State and Local government departments and individuals have been generous with their time, data, and feedback through various workshops and engagement channels and their inputs have been crucial to the development of the DEA Coastal Ecosystems product suite. | ||
|
|
||
|
|
||
| ## License and copyright | ||
|
|
||
| © Commonwealth of Australia (Geoscience Australia). | ||
|
|
||
| Released under [Creative Commons Attribution 4.0 International Licence](https://creativecommons.org/licenses/by/4.0/). | ||
|
|
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,123 @@ | ||
| # See the Product metadata fields documentation: https://docs.dev.dea.ga.gov.au/public_services/dea_knowledge_hub/product_metadata_fields.html | ||
|
|
||
| # Specifications | ||
|
|
||
| short_name: DEA Coastal Ecosystems | ||
| full_technical_name: Geoscience Australia Sentinel-2 Coastal Ecosystems Calendar Year Collection 3 | ||
| header_image: /_files/dea-coastalecosystems/classification_Shoalwater_2021_thumbnail.png | ||
|
|
||
| version_number: 1.0.0 | ||
| is_latest_version: true | ||
| latest_version_link: /data/product/dea-coastal-ecosystems/ | ||
| is_provisional: false | ||
|
|
||
| lineage_type: DERIVATIVE | ||
| spatial_data_type: RASTER | ||
|
|
||
| spatial_coverage: Australia excluding external territories | ||
| temporal_coverage_start: 2021 | ||
| temporal_coverage_end: 2022 | ||
| temporal_coverage_custom: null | ||
|
|
||
| data_update_frequency: NONE | ||
| data_update_activity: NON_ONGOING | ||
| is_currency_reported: false | ||
|
|
||
| resolution: 10 m | ||
| coordinate_reference_system: EPSG:3577 | ||
|
|
||
| product_ids: | ||
| - ga_s2_coastalecosystems_cyear_3_v1 | ||
|
|
||
| parent_products: | ||
| - name: Sentinel-2A Surface Reflectance NBART | ||
| link: /data/product/dea-surface-reflectance-nbart-sentinel-2a-msi/ | ||
| - name: Sentinel-2A Observational Attributes | ||
| link: /data/product/dea-surface-reflectance-oa-sentinel-2a-msi/ | ||
| - name: Sentinel-2B Surface Reflectance NBART | ||
| link: /data/product/dea-surface-reflectance-nbart-sentinel-2b-msi/ | ||
| - name: Sentinel-2B Observational Attributes | ||
| link: /data/product/dea-surface-reflectance-oa-sentinel-2b-msi/ | ||
|
|
||
| collections: | ||
| - name: Geoscience Australia Sentinel-2 Collection 3 | ||
| link: /search/?q=Geoscience+Australia+Sentinel-2+Collection+3 | ||
|
|
||
| doi: 10.26186/150770 | ||
| ecat_id: "150770" | ||
|
Collaborator
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. @erialC-P I got these from the ecat page. We should just double check the DOI and eCat are correct before we publish. |
||
|
|
||
| licence_name: Creative Commons Attribution 4.0 International Licence | ||
| licence_link: https://creativecommons.org/licenses/by/4.0/ | ||
|
|
||
| citation_data: "Phillips, C., Newey, V., Lyons, M., Sagar, S., Bishop-Taylor, R., DEA Coastal Ecosystems. Commonwealth of Australia (Geoscience Australia). https://doi.org/10.26186/150770" | ||
| # citation_paper: "Bishop-Taylor, R., Nanson, R., Sagar, S., Lymburner, L. (2021). Mapping Australia's dynamic coastline at mean sea level using three decades of Landsat imagery. Remote Sensing of Environment, 267, 112734. https://doi.org/10.1016/j.rse.2021.112734" | ||
|
|
||
| # citations_custom: | ||
| # - name: Custom citation | ||
| # citation: "Bishop-Taylor, R., Nanson, R., Sagar, S., Lymburner, L. (2021). Mapping Australia's dynamic coastline at mean sea level using three decades of Landsat imagery. Remote Sensing of Environment, 267, 112734. https://doi.org/10.1016/j.rse.2021.112734" | ||
|
|
||
| tags: | ||
| - geoscience_australia_sentinel_2_collection_3 | ||
| - coastal_ecosystems | ||
| - marine_and_coastal | ||
| - coast | ||
| - machine_learning | ||
| - intertidal | ||
| - coastal_change | ||
|
|
||
| # Access | ||
|
|
||
| access_links_maps: | ||
| - link: https://maps.dea.ga.gov.au/story/DEACoastalecosystems | ||
| name: null | ||
|
|
||
| access_links_explorers: | ||
| - link: https://explorer.dea.ga.gov.au/products/ga_s2_coastalecosystems_cyear_3_v1 | ||
| name: null | ||
|
|
||
| access_links_data: null | ||
|
|
||
| access_links_code_examples: | ||
| - link: /notebooks/DEA_products/DEA_Coastalecosystems/ | ||
| name: View code examples (DEA Notebook) | ||
|
|
||
| access_links_web_services: | ||
| - link: https://ows.dea.ga.gov.au/ | ||
| name: Web Map Service (WMS) | ||
|
|
||
| access_links_custom: | ||
| - link: https://data.dea.ga.gov.au/?prefix=derivative/ga_s2_coastalecosystems_cyear_3_v1/AU | ||
| icon: database | ||
| label: Data sources | ||
| name: Access the data on AWS | ||
| description: "Learn **how to stream data from AWS below (the recommended method)** or `other ways to download from AWS </guides/about/faq/#download-dea-data>`_." | ||
| class: null | ||
| # - link: https://github.com/GeoscienceAustralia/dea-coastalecosystems | ||
| # icon: code-branch | ||
| # label: Source code | ||
| # name: "Source code on GitHub" | ||
| # description: "The GitHub repository is GeoscienceAustralia/dea-coastalecosystems." | ||
| # class: null | ||
|
|
||
| # History | ||
|
|
||
| # previous_versions: | ||
| # - version_number: 1.0.0 | ||
| # title: Example product | ||
| # slug: example-product-1.0.0 | ||
|
|
||
| # SEO | ||
|
|
||
| # meta_description: This field can be used for SEO. | ||
|
|
||
| # Settings | ||
|
|
||
| enable_overview: true | ||
| enable_description: true | ||
| enable_quality: true | ||
| enable_specifications: true | ||
| enable_access: true | ||
| enable_history: true | ||
| enable_faqs: false | ||
| enable_credits: true | ||
|
|
||
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Uh oh!
There was an error while loading. Please reload this page.