sgiordano commited on
Commit
17e2ab1
1 Parent(s): e5dd117

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +14 -19
README.md CHANGED
@@ -85,13 +85,13 @@ pipeline_tag: image-segmentation
85
  <br>
86
 
87
  <div style="border:1px solid black; padding:25px; background-color:#FDFFF4 ; padding-top:10px; padding-bottom:1px;">
88
- <h1>FLAIR-INC_rgbie_15cl_resnet34-unet</h1>
89
- <p>The general characteristics of this specific model <strong>FLAIR-INC_rgbie_15cl_resnet34-unet</strong> are :</p>
90
  <ul style="list-style-type:disc;">
91
  <li>Trained with the FLAIR-INC dataset</li>
92
  <li>RGBIE images (true colours + infrared + elevation)</li>
93
  <li>U-Net with a Resnet-34 encoder</li>
94
- <li>15 class nomenclature : [building, pervious surface, impervious surface, bare soil, water, coniferous, deciduous, brushwood, vineyard, herbaceous, agricultural land, plowed land, swimming pool, snow, greenhouse]</li>
95
  </ul>
96
  </div>
97
 
@@ -113,7 +113,7 @@ The product called ([BD ORTHO®](https://geoservices.ign.fr/bdortho)) has its ow
113
  Consequently, the model’s prediction would improve if the user images are similar to the original ones.
114
 
115
  _**Radiometry of input images**_ :
116
- The BD ORTHO input images are distributed in 8-bit encoding format per channel. When traning the model, input normalization was performed (see section **Trainingg Details**).
117
  It is recommended that the user apply the same type of input normalization while inferring the model.
118
 
119
  _**Multi-domain model**_ :
@@ -127,23 +127,23 @@ When decoded to [0,255] ints, a difference of 1 should coresponds to 0.2 meters
127
 
128
  _**Land Cover classes of prediction**_ :
129
  The orginial class nomenclature of the FLAIR Dataset encompasses 19 classes (See the [FLAIR dataset](https://huggingface.co/datasets/IGNF/FLAIR) page for details).
130
- However 3 classes corresponding to uncertain labelisation (Mixed (16), Ligneous (17) and Other (19)) and 1 class with very poor labelling (Clear cut (15)) were desactivated during training.
131
- As a result, the logits produced by the model are of size 19x1, but classes n° 15, 16, 17 and 19 should appear at 0 in the logits and should not be present in the final argmax product.
132
 
133
 
134
 
135
  ## Bias, Risks, Limitations and Recommendations
136
 
137
  _**Using the model on input images with other spatial resolution**_ :
138
- The FLAIR-INC_rgbie_15cl_resnet34-unet model was trained with fixed scale conditions. All patches used for training are derived from aerial images with 0.2 meters spatial resolution. Only flip and rotate augmentations were performed during the training process.
139
  No data augmentation method concerning scale change was used during training. The user should pay attention that generalization issues can occur while applying this model to images that have different spatial resolutions.
140
 
141
  _**Using the model for other remote sensing sensors**_ :
142
- The FLAIR-INC_rgbie_15cl_resnet34-unet model was trained with aerial images of the ([BD ORTHO® product](https://geoservices.ign.fr/bdortho)) that encopass very specific radiometric image processing.
143
  Using the model on other type of aerial images or satellite images may imply the use of transfer learning or domain adaptation techniques.
144
 
145
  _**Using the model on other spatial areas**_ :
146
- The FLAIR-INC_rgbie_15cl_resnet34-unet model was trained on patches reprensenting the French Metropolitan territory.
147
  The user should be aware that applying the model to other type of landscapes may imply a drop in model metrics.
148
 
149
  ---
@@ -160,7 +160,7 @@ Fine-tuning and prediction tasks are detailed in the README file.
160
 
161
  ### Training Data
162
 
163
- 218 400 patches of 512 x 512 pixels were used to train the **FLAIR-INC_RVBIE_resnet34_unet_15cl_norm** model.
164
  The train/validation split was performed patchwise to obtain a 80% / 20% distribution between train and validation.
165
  Annotation was performed at the _zone_ level (~100 patches per _zone_). Spatial independancy between patches is guaranted as patches from the same _zone_ were assigned to the same set (TRAIN or VALIDATION).
166
  The following number of patches were used for train and validation :
@@ -212,10 +212,10 @@ Statistics of the TRAIN+VALIDATION set :
212
 
213
  #### Speeds, Sizes, Times
214
 
215
- The FLAIR-INC_rgbie_15cl_resnet34-unet model was trained on a HPC/AI resources provided by GENCI-IDRIS (Grant 2022-A0131013803).
216
  16 V100 GPUs were used ( 4 nodes, 4 GPUS per node). With this configuration the approximate learning time is 6 minutes per epoch.
217
 
218
- FLAIR-INC_rgbie_15cl_resnet34-unet was obtained for num_epoch=65 with corresponding val_loss=0.55.
219
 
220
 
221
  <div style="position: relative; text-align: center;">
@@ -237,13 +237,11 @@ The evaluation was performed on a TEST set of 31 750 patches that are independan
237
  The TEST set corresponds to the reunion of the TEST set of scientific challenges FLAIR#1 and FLAIR#2. See the [FLAIR challenge page](https://ignf.github.io/FLAIR/) for more details.
238
 
239
  The choice of a separate TEST set instead of cross validation was made to be coherent with the FLAIR challenges.
240
- However the metrics for the Challenge were calculated on 12 classes and the TEST set acordingly.
241
- As a result the _Snow_ class is absent from the TEST set.
242
 
243
  #### Metrics
244
 
245
- With the evaluation protocol, the **FLAIR-INC_RVBIE_resnet34_unet_15cl_norm** have been evaluated to **OA=76.509%** and **mIoU=62.716%**.
246
- The _snow_ class is discarded from the average metrics.
247
 
248
  The following table give the class-wise metrics :
249
 
@@ -267,9 +265,6 @@ The following table give the class-wise metrics :
267
 
268
 
269
 
270
-
271
-
272
-
273
  The following illustration gives the resulting confusion matrix :
274
  * Top : normalised acording to columns, columns sum at 100% and the **precision** is on the diagonal of the matrix
275
  * Bottom : normalised acording to rows, rows sum at 100% and the **recall** is on the diagonal of the matrix
 
85
  <br>
86
 
87
  <div style="border:1px solid black; padding:25px; background-color:#FDFFF4 ; padding-top:10px; padding-bottom:1px;">
88
+ <h1>FLAIR-INC_rgbie_12cl_resnet34-unet</h1>
89
+ <p>The general characteristics of this specific model <strong>FLAIR-INC_rgbie_12cl_resnet34-unet</strong> are :</p>
90
  <ul style="list-style-type:disc;">
91
  <li>Trained with the FLAIR-INC dataset</li>
92
  <li>RGBIE images (true colours + infrared + elevation)</li>
93
  <li>U-Net with a Resnet-34 encoder</li>
94
+ <li>12 class nomenclature : [building, pervious surface, impervious surface, bare soil, water, coniferous, deciduous, brushwood, vineyard, herbaceous, agricultural land, plowed land]</li>
95
  </ul>
96
  </div>
97
 
 
113
  Consequently, the model’s prediction would improve if the user images are similar to the original ones.
114
 
115
  _**Radiometry of input images**_ :
116
+ The BD ORTHO input images are distributed in 8-bit encoding format per channel. When traning the model, input normalization was performed (see section **Training Details**).
117
  It is recommended that the user apply the same type of input normalization while inferring the model.
118
 
119
  _**Multi-domain model**_ :
 
127
 
128
  _**Land Cover classes of prediction**_ :
129
  The orginial class nomenclature of the FLAIR Dataset encompasses 19 classes (See the [FLAIR dataset](https://huggingface.co/datasets/IGNF/FLAIR) page for details).
130
+ This model was trained to be coherent withe the FLAIR#1 scientific challenge in which contestants were evaluated of the first 12 classes of the nomenclature. Classes with label greater than 12 were desactivated during training.
131
+ As a result, the logits produced by the model are of size 19x1, but classes n° 13, 14, 15, 16, 17, 18 and 19 should appear at 0 in the logits and should not be present in the final argmax product.
132
 
133
 
134
 
135
  ## Bias, Risks, Limitations and Recommendations
136
 
137
  _**Using the model on input images with other spatial resolution**_ :
138
+ The FLAIR-INC_rgbie_12cl_resnet34-unet model was trained with fixed scale conditions. All patches used for training are derived from aerial images with 0.2 meters spatial resolution. Only flip and rotate augmentations were performed during the training process.
139
  No data augmentation method concerning scale change was used during training. The user should pay attention that generalization issues can occur while applying this model to images that have different spatial resolutions.
140
 
141
  _**Using the model for other remote sensing sensors**_ :
142
+ The FLAIR-INC_rgbie_12cl_resnet34-unet was trained with aerial images of the ([BD ORTHO® product](https://geoservices.ign.fr/bdortho)) that encopass very specific radiometric image processing.
143
  Using the model on other type of aerial images or satellite images may imply the use of transfer learning or domain adaptation techniques.
144
 
145
  _**Using the model on other spatial areas**_ :
146
+ The FLAIR-INC_rgbie_12cl_resnet34-unet model was trained on patches reprensenting the French Metropolitan territory.
147
  The user should be aware that applying the model to other type of landscapes may imply a drop in model metrics.
148
 
149
  ---
 
160
 
161
  ### Training Data
162
 
163
+ 218 400 patches of 512 x 512 pixels were used to train the **FLAIR-INC_rgbie_12cl_resnet34-unet** model.
164
  The train/validation split was performed patchwise to obtain a 80% / 20% distribution between train and validation.
165
  Annotation was performed at the _zone_ level (~100 patches per _zone_). Spatial independancy between patches is guaranted as patches from the same _zone_ were assigned to the same set (TRAIN or VALIDATION).
166
  The following number of patches were used for train and validation :
 
212
 
213
  #### Speeds, Sizes, Times
214
 
215
+ The FLAIR-INC_rgbie_12cl_resnet34-unet model was trained on a HPC/AI resources provided by GENCI-IDRIS (Grant 2022-A0131013803).
216
  16 V100 GPUs were used ( 4 nodes, 4 GPUS per node). With this configuration the approximate learning time is 6 minutes per epoch.
217
 
218
+ FLAIR-INC_rgbie_12cl_resnet34-unet was obtained for num_epoch=65 with corresponding val_loss=0.55.
219
 
220
 
221
  <div style="position: relative; text-align: center;">
 
237
  The TEST set corresponds to the reunion of the TEST set of scientific challenges FLAIR#1 and FLAIR#2. See the [FLAIR challenge page](https://ignf.github.io/FLAIR/) for more details.
238
 
239
  The choice of a separate TEST set instead of cross validation was made to be coherent with the FLAIR challenges.
240
+
 
241
 
242
  #### Metrics
243
 
244
+ With the evaluation protocol, the **FLAIR-INC_rgbie_12cl_resnet34-unet** have been evaluated to **OA=76.509%** and **mIoU=62.716%**.
 
245
 
246
  The following table give the class-wise metrics :
247
 
 
265
 
266
 
267
 
 
 
 
268
  The following illustration gives the resulting confusion matrix :
269
  * Top : normalised acording to columns, columns sum at 100% and the **precision** is on the diagonal of the matrix
270
  * Bottom : normalised acording to rows, rows sum at 100% and the **recall** is on the diagonal of the matrix