Create db schema and injest data #3

New issue

Closed

opened 2021-10-13 07:49:17 +13:00 by danalambert · 14 comments

danalambert commented 2021-10-13 07:49:17 +13:00 (Migrated from gitlab.catalyst.net.nz)

Copy link

• Create db schema design
• Create django models to reflect schema
• Import and injest plant data from excel spreadsheet
• Import and injest soil data from shapefile
• Import and injest eco region data
• Create a command that populates the database with the given data
• Document process

- [x] Create db schema design - [x] Create django models to reflect schema - [x] Import and injest plant data from excel spreadsheet - [x] Import and injest soil data from shapefile - [x] Import and injest eco region data - [x] Create a command that populates the database with the given data - [x] Document process

danalambert commented 2021-10-13 07:49:18 +13:00 (Migrated from gitlab.catalyst.net.nz)

Copy link

assigned to @danalambert

assigned to @danalambert

danalambert commented 2021-10-14 11:47:58 +13:00 (Migrated from gitlab.catalyst.net.nz)

Copy link

SoilOrder discrepancies and assumptions:

Mappings between the codes used in the soil layers and the names in the spreadsheet have been manually created based on the document provided by LRIS data dictionary here under Appendix 3. New Zealand Soil Classification Subgroups.

I'm treating orders separated by underscores the same as those separated by , as independent orders.

Unknown fields:

• Lake
• Saline
• Arid
• Allophane

Also looks like there are some other categories that the soil layers use under order which are not really soil types at all but are required for classification. These are presented as lowercase orders such as i for ice, t for town. Here is an extract from the LRIS data dict that reflects these:

I'm going to add these extra types to the database.

**SoilOrder discrepancies and assumptions:** Mappings between the codes used in the soil layers and the names in the spreadsheet have been manually created based on the document provided by LRIS data dictionary [here](https://lris.scinfo.org.nz/document/9162-lris-data-dictionary-v3/) under `Appendix 3. New Zealand Soil Classification Subgroups`. I'm treating orders separated by underscores the same as those separated by `,` as independent orders. Unknown fields: * Lake * Saline * Arid * Allophane Also looks like there are some other categories that the soil layers use under order which are not really soil types at all but are required for classification. These are presented as lowercase orders such as `i` for `ice`, `t` for `town`. Here is an extract from the LRIS data dict that reflects these:  I'm going to add these extra types to the database.

danalambert commented 2021-10-14 13:39:58 +13:00 (Migrated from gitlab.catalyst.net.nz)

Copy link

EcologicalRegion discrepancies and assumptions:

• D’Archiac and D'Archiac both exist with different apostrophe types.
• , separators are inconsistent in spacing, this will be stripped

From spreadsheet -> ecological district layer data, the following adjustments/mappings are being applied:

{
    "Whakatane": "Whatkatane",
    "North West Nelson": "North-west Nelson",
    "Aorangi": "Aorrangi",
    "Mackenzie": "MacKenzie",
    "Southland Hills": "Southland Foothills",
    "Sounds Wellington": "Sounds-Wellington"
}

There appear to be four extra regions in the spredsheet data which are not included in the layer provided. Not sure if some are typos or not? These entries will be ignored for now. They include the following:

• Aupouri
• Chatham
• Kermadec
• Makarora
• Maowhanga

**EcologicalRegion discrepancies and assumptions:** * `D’Archiac` and `D'Archiac` both exist with different apostrophe types. * `,` separators are inconsistent in spacing, this will be stripped From spreadsheet -> ecological district layer data, the following adjustments/mappings are being applied: ```json { "Whakatane": "Whatkatane", "North West Nelson": "North-west Nelson", "Aorangi": "Aorrangi", "Mackenzie": "MacKenzie", "Southland Hills": "Southland Foothills", "Sounds Wellington": "Sounds-Wellington" } ``` There appear to be four extra regions in the spredsheet data which are not included in the layer provided. Not sure if some are typos or not? These entries will be ignored for now. They include the following: - Aupouri - Chatham - Kermadec - Makarora - Maowhanga

danalambert commented 2021-10-15 12:13:59 +13:00 (Migrated from gitlab.catalyst.net.nz)

Copy link

Spreadsheet notes:

• Cell E260 contains a date field
• Multiple maxheight fields are invalid a string has been provided rather than a float.
• Some fields are empty where data is expected

60 invalid rows have been skipped. Here are the logs:

Error occured while adding the row for Aciphylla scott-thomsonii.
<class 'TypeError'>: Invalid string length for commonname with value giant spaniard; giant speargrass; taramea; blue spaniard. Expected length to be under 50 but was 56.
SKIPPING ROW...
----------------------------------------------
Error occured while adding the row for Alepis flavida.
<class 'TypeError'>: Invalid json type for field maxheight with value hemiparasite. Expected '<class 'float'>' but got '<class 'str'>'.
SKIPPING ROW...
----------------------------------------------
Error occured while adding the row for Blechnum chambersii.
<class 'TypeError'>: Invalid json type for field spacing with value 0..5. Expected '<class 'float'>' but got '<class 'str'>'.
SKIPPING ROW...
----------------------------------------------
Error occured while adding the row for Brachyglottis lagopus/bellidioides.
<class 'AttributeError'>: 'NoneType' object has no attribute 'split'
SKIPPING ROW...
----------------------------------------------
Error occured while adding the row for Calystegia marginata.
<class 'TypeError'>: Invalid json type for field maxheight with value vine. Expected '<class 'float'>' but got '<class 'str'>'.
SKIPPING ROW...
----------------------------------------------
Error occured while adding the row for Calystegia sepium.
<class 'TypeError'>: Invalid json type for field maxheight with value vine. Expected '<class 'float'>' but got '<class 'str'>'.
SKIPPING ROW...
----------------------------------------------
Error occured while adding the row for Calystegia tuguriorum.
<class 'TypeError'>: Invalid json type for field maxheight with value vine. Expected '<class 'float'>' but got '<class 'str'>'.
SKIPPING ROW...
----------------------------------------------
Error occured while adding the row for Clematis cunninghamii.
<class 'TypeError'>: Invalid json type for field maxheight with value vine. Expected '<class 'float'>' but got '<class 'str'>'.
SKIPPING ROW...
----------------------------------------------
Error occured while adding the row for Clematis foetida.
<class 'TypeError'>: Invalid json type for field maxheight with value vine. Expected '<class 'float'>' but got '<class 'str'>'.
SKIPPING ROW...
----------------------------------------------
Error occured while adding the row for Clematis forsteri.
<class 'TypeError'>: Invalid json type for field maxheight with value vine. Expected '<class 'float'>' but got '<class 'str'>'.
SKIPPING ROW...
----------------------------------------------
Error occured while adding the row for Clematis marata.
<class 'TypeError'>: Invalid json type for field maxheight with value vine. Expected '<class 'float'>' but got '<class 'str'>'.
SKIPPING ROW...
----------------------------------------------
Error occured while adding the row for Clematis paniculata.
<class 'TypeError'>: Invalid json type for field maxheight with value vine. Expected '<class 'float'>' but got '<class 'str'>'.
SKIPPING ROW...
----------------------------------------------
Error occured while adding the row for Clematis petriei.
<class 'TypeError'>: Invalid json type for field maxheight with value vine. Expected '<class 'float'>' but got '<class 'str'>'.
SKIPPING ROW...
----------------------------------------------
Error occured while adding the row for Clematis quadribracteolata.
<class 'TypeError'>: Invalid json type for field maxheight with value vine. Expected '<class 'float'>' but got '<class 'str'>'.
SKIPPING ROW...
----------------------------------------------
Error occured while adding the row for Collospermum hastatum.
<class 'TypeError'>: Invalid json type for field maxheight with value epiphyte. Expected '<class 'float'>' but got '<class 'str'>'.
SKIPPING ROW...
----------------------------------------------
Error occured while adding the row for Coprosma grandifolia.
<class 'TypeError'>: Invalid json type for field spacing with value 2014-01-01 00:00:00. Expected '<class 'float'>' but got '<class 'datetime.datetime'>'.
SKIPPING ROW...
----------------------------------------------
Error occured while adding the row for Cordyline indivisa.
<class 'TypeError'>: Invalid string length for commonname with value toi; mountain cabbage tree; broad-leaved cabbage tree. Expected length to be under 50 but was 53.
SKIPPING ROW...
----------------------------------------------
Error occured while adding the row for Cyperus ustulatus.
<class 'TypeError'>: Invalid string length for commonname with value giant umbrella sedge; toetoe upokotangata; coastal cutty grass. Expected length to be under 50 but was 62.
SKIPPING ROW...
----------------------------------------------
Error occured while adding the row for Festuca actae.
<class 'TypeError'>: Invalid json type for field maxheight with value None. Expected '<class 'float'>' but got '<class 'NoneType'>'.
SKIPPING ROW...
----------------------------------------------
Error occured while adding the row for Herpolirion novae-zelandiae.
<class 'AttributeError'>: 'NoneType' object has no attribute 'split'
SKIPPING ROW...
----------------------------------------------
Error occured while adding the row for Ileostylus micranthus.
<class 'TypeError'>: Invalid json type for field maxheight with value hemiparasite. Expected '<class 'float'>' but got '<class 'str'>'.
SKIPPING ROW...
----------------------------------------------
Error occured while adding the row for Korthalsella clavata.
<class 'TypeError'>: Invalid json type for field maxheight with value hemiparasite. Expected '<class 'float'>' but got '<class 'str'>'.
SKIPPING ROW...
----------------------------------------------
Error occured while adding the row for Korthalsella lindsayi.
<class 'TypeError'>: Invalid json type for field maxheight with value hemiparasite. Expected '<class 'float'>' but got '<class 'str'>'.
SKIPPING ROW...
----------------------------------------------
Error occured while adding the row for Korthalsella salicornioides.
<class 'TypeError'>: Invalid json type for field maxheight with value hemiparasite. Expected '<class 'float'>' but got '<class 'str'>'.
SKIPPING ROW...
----------------------------------------------
Error occured while adding the row for Lepilaena bilocularis.
<class 'TypeError'>: Invalid json type for field maxheight with value aquatic. Expected '<class 'float'>' but got '<class 'str'>'.
SKIPPING ROW...
----------------------------------------------
Error occured while adding the row for Leptopteris superba.
<class 'TypeError'>: Invalid string length for commonname with value crape fern; prince of wales feathers; ngutungutu kiwi. Expected length to be under 50 but was 53.
SKIPPING ROW...
----------------------------------------------
Error occured while adding the row for Metrosideros albiflora.
<class 'TypeError'>: Invalid json type for field maxheight with value vine. Expected '<class 'float'>' but got '<class 'str'>'.
SKIPPING ROW...
----------------------------------------------
Error occured while adding the row for Metrosideros carminea.
<class 'TypeError'>: Invalid json type for field maxheight with value vine. Expected '<class 'float'>' but got '<class 'str'>'.
SKIPPING ROW...
----------------------------------------------
Error occured while adding the row for Metrosideros colensoi.
<class 'TypeError'>: Invalid json type for field maxheight with value vine. Expected '<class 'float'>' but got '<class 'str'>'.
SKIPPING ROW...
----------------------------------------------
Error occured while adding the row for Metrosideros diffusa.
<class 'TypeError'>: Invalid json type for field maxheight with value vine. Expected '<class 'float'>' but got '<class 'str'>'.
SKIPPING ROW...
----------------------------------------------
Error occured while adding the row for Metrosideros fulgens.
<class 'TypeError'>: Invalid json type for field maxheight with value vine. Expected '<class 'float'>' but got '<class 'str'>'.
SKIPPING ROW...
----------------------------------------------
Error occured while adding the row for Metrosideros parkinsonii.
<class 'TypeError'>: Invalid json type for field maxheight with value 7m. Expected '<class 'float'>' but got '<class 'str'>'.
SKIPPING ROW...
----------------------------------------------
Error occured while adding the row for Metrosideros perforata.
<class 'TypeError'>: Invalid json type for field maxheight with value vine. Expected '<class 'float'>' but got '<class 'str'>'.
SKIPPING ROW...
----------------------------------------------
Error occured while adding the row for Myriophyllum pedunculatum.
<class 'TypeError'>: Invalid json type for field maxheight with value aquatic. Expected '<class 'float'>' but got '<class 'str'>'.
SKIPPING ROW...
----------------------------------------------
Error occured while adding the row for Myriophyllum propinquum.
<class 'TypeError'>: Invalid json type for field maxheight with value aquatic. Expected '<class 'float'>' but got '<class 'str'>'.
SKIPPING ROW...
----------------------------------------------
Error occured while adding the row for Myriophyllum robustum.
<class 'TypeError'>: Invalid json type for field maxheight with value aquatic. Expected '<class 'float'>' but got '<class 'str'>'.
SKIPPING ROW...
----------------------------------------------
Error occured while adding the row for Myriophyllum triphyllum.
<class 'TypeError'>: Invalid json type for field maxheight with value aquatic. Expected '<class 'float'>' but got '<class 'str'>'.
SKIPPING ROW...
----------------------------------------------
Error occured while adding the row for Nasturtium spp.
<class 'TypeError'>: Invalid json type for field maxheight with value aquatic. Expected '<class 'float'>' but got '<class 'str'>'.
SKIPPING ROW...
----------------------------------------------
Error occured while adding the row for Nothofagus solandri.
<class 'TypeError'>: Invalid string length for commonname with value mountain beech (var. cliffortioides); black beech (var. solandri); tawhai rauriki. Expected length to be under 50 but was 81.
SKIPPING ROW...
----------------------------------------------
Error occured while adding the row for Parsonsia capsularis.
<class 'TypeError'>: Invalid json type for field maxheight with value vine. Expected '<class 'float'>' but got '<class 'str'>'.
SKIPPING ROW...
----------------------------------------------
Error occured while adding the row for Parsonsia heterophylla.
<class 'TypeError'>: Invalid json type for field maxheight with value vine. Expected '<class 'float'>' but got '<class 'str'>'.
SKIPPING ROW...
----------------------------------------------
Error occured while adding the row for Passiflora tetrandra.
<class 'TypeError'>: Invalid json type for field maxheight with value vine. Expected '<class 'float'>' but got '<class 'str'>'.
SKIPPING ROW...
----------------------------------------------
Error occured while adding the row for Peraxilla colensoi.
<class 'TypeError'>: Invalid json type for field maxheight with value hemiparasite. Expected '<class 'float'>' but got '<class 'str'>'.
SKIPPING ROW...
----------------------------------------------
Error occured while adding the row for Peraxilla tetrapatela.
<class 'TypeError'>: Invalid json type for field maxheight with value hemiparasite. Expected '<class 'float'>' but got '<class 'str'>'.
SKIPPING ROW...
----------------------------------------------
Error occured while adding the row for Pittosporum cornifolium.
<class 'TypeError'>: Invalid json type for field maxheight with value epiphyte. Expected '<class 'float'>' but got '<class 'str'>'.
SKIPPING ROW...
----------------------------------------------
Error occured while adding the row for Potamogeton cheesemanii.
<class 'TypeError'>: Invalid json type for field maxheight with value aquatic. Expected '<class 'float'>' but got '<class 'str'>'.
SKIPPING ROW...
----------------------------------------------
Error occured while adding the row for Potamogeton ochreatus.
<class 'TypeError'>: Invalid json type for field maxheight with value aquatic. Expected '<class 'float'>' but got '<class 'str'>'.
SKIPPING ROW...
----------------------------------------------
Error occured while adding the row for Potamogeton pectinatus.
<class 'TypeError'>: Invalid json type for field maxheight with value aquatic. Expected '<class 'float'>' but got '<class 'str'>'.
SKIPPING ROW...
----------------------------------------------
Error occured while adding the row for Potamogeton suboblongus.
<class 'TypeError'>: Invalid json type for field maxheight with value aquatic. Expected '<class 'float'>' but got '<class 'str'>'.
SKIPPING ROW...
----------------------------------------------
Error occured while adding the row for Pyrrosia eleagnifolia.
<class 'TypeError'>: Invalid json type for field maxheight with value epiphyte. Expected '<class 'float'>' but got '<class 'str'>'.
SKIPPING ROW...
----------------------------------------------
Error occured while adding the row for Ripogonum scandens.
<class 'TypeError'>: Invalid json type for field maxheight with value vine. Expected '<class 'float'>' but got '<class 'str'>'.
SKIPPING ROW...
----------------------------------------------
Error occured while adding the row for Rubus australis.
<class 'TypeError'>: Invalid json type for field maxheight with value vine. Expected '<class 'float'>' but got '<class 'str'>'.
SKIPPING ROW...
----------------------------------------------
Error occured while adding the row for Rubus cissoides.
<class 'TypeError'>: Invalid json type for field maxheight with value vine. Expected '<class 'float'>' but got '<class 'str'>'.
SKIPPING ROW...
----------------------------------------------
Error occured while adding the row for Rubus parvus.
<class 'TypeError'>: Invalid json type for field maxheight with value None. Expected '<class 'float'>' but got '<class 'NoneType'>'.
SKIPPING ROW...
----------------------------------------------
Error occured while adding the row for Rubus schmidelioides.
<class 'TypeError'>: Invalid json type for field maxheight with value vine. Expected '<class 'float'>' but got '<class 'str'>'.
SKIPPING ROW...
----------------------------------------------
Error occured while adding the row for Ruppia megacarpa.
<class 'TypeError'>: Invalid json type for field maxheight with value aquatic. Expected '<class 'float'>' but got '<class 'str'>'.
SKIPPING ROW...
----------------------------------------------
Error occured while adding the row for Ruppia polycarpa.
<class 'TypeError'>: Invalid json type for field maxheight with value aquatic. Expected '<class 'float'>' but got '<class 'str'>'.
SKIPPING ROW...
----------------------------------------------
Error occured while adding the row for Scandia rosifolia.
<class 'TypeError'>: Invalid json type for field maxheight with value vine. Expected '<class 'float'>' but got '<class 'str'>'.
SKIPPING ROW...
----------------------------------------------
Error occured while adding the row for Tupeia antarctica.
<class 'TypeError'>: Invalid json type for field maxheight with value mistletoe. Expected '<class 'float'>' but got '<class 'str'>'.
SKIPPING ROW...
----------------------------------------------
Error occured while adding the row for Zannichellia palustris.
<class 'TypeError'>: Invalid json type for field maxheight with value aquatic. Expected '<class 'float'>' but got '<class 'str'>'.
SKIPPING ROW...
----------------------------------------------

**Spreadsheet notes:** * Cell `E260` contains a date field * Multiple `maxheight` fields are invalid a string has been provided rather than a float. * Some fields are empty where data is expected 60 invalid rows have been skipped. Here are the logs: ``` Error occured while adding the row for Aciphylla scott-thomsonii. <class 'TypeError'>: Invalid string length for commonname with value giant spaniard; giant speargrass; taramea; blue spaniard. Expected length to be under 50 but was 56. SKIPPING ROW... ---------------------------------------------- Error occured while adding the row for Alepis flavida. <class 'TypeError'>: Invalid json type for field maxheight with value hemiparasite. Expected '<class 'float'>' but got '<class 'str'>'. SKIPPING ROW... ---------------------------------------------- Error occured while adding the row for Blechnum chambersii. <class 'TypeError'>: Invalid json type for field spacing with value 0..5. Expected '<class 'float'>' but got '<class 'str'>'. SKIPPING ROW... ---------------------------------------------- Error occured while adding the row for Brachyglottis lagopus/bellidioides. <class 'AttributeError'>: 'NoneType' object has no attribute 'split' SKIPPING ROW... ---------------------------------------------- Error occured while adding the row for Calystegia marginata. <class 'TypeError'>: Invalid json type for field maxheight with value vine. Expected '<class 'float'>' but got '<class 'str'>'. SKIPPING ROW... ---------------------------------------------- Error occured while adding the row for Calystegia sepium. <class 'TypeError'>: Invalid json type for field maxheight with value vine. Expected '<class 'float'>' but got '<class 'str'>'. SKIPPING ROW... ---------------------------------------------- Error occured while adding the row for Calystegia tuguriorum. <class 'TypeError'>: Invalid json type for field maxheight with value vine. Expected '<class 'float'>' but got '<class 'str'>'. SKIPPING ROW... ---------------------------------------------- Error occured while adding the row for Clematis cunninghamii. <class 'TypeError'>: Invalid json type for field maxheight with value vine. Expected '<class 'float'>' but got '<class 'str'>'. SKIPPING ROW... ---------------------------------------------- Error occured while adding the row for Clematis foetida. <class 'TypeError'>: Invalid json type for field maxheight with value vine. Expected '<class 'float'>' but got '<class 'str'>'. SKIPPING ROW... ---------------------------------------------- Error occured while adding the row for Clematis forsteri. <class 'TypeError'>: Invalid json type for field maxheight with value vine. Expected '<class 'float'>' but got '<class 'str'>'. SKIPPING ROW... ---------------------------------------------- Error occured while adding the row for Clematis marata. <class 'TypeError'>: Invalid json type for field maxheight with value vine. Expected '<class 'float'>' but got '<class 'str'>'. SKIPPING ROW... ---------------------------------------------- Error occured while adding the row for Clematis paniculata. <class 'TypeError'>: Invalid json type for field maxheight with value vine. Expected '<class 'float'>' but got '<class 'str'>'. SKIPPING ROW... ---------------------------------------------- Error occured while adding the row for Clematis petriei. <class 'TypeError'>: Invalid json type for field maxheight with value vine. Expected '<class 'float'>' but got '<class 'str'>'. SKIPPING ROW... ---------------------------------------------- Error occured while adding the row for Clematis quadribracteolata. <class 'TypeError'>: Invalid json type for field maxheight with value vine. Expected '<class 'float'>' but got '<class 'str'>'. SKIPPING ROW... ---------------------------------------------- Error occured while adding the row for Collospermum hastatum. <class 'TypeError'>: Invalid json type for field maxheight with value epiphyte. Expected '<class 'float'>' but got '<class 'str'>'. SKIPPING ROW... ---------------------------------------------- Error occured while adding the row for Coprosma grandifolia. <class 'TypeError'>: Invalid json type for field spacing with value 2014-01-01 00:00:00. Expected '<class 'float'>' but got '<class 'datetime.datetime'>'. SKIPPING ROW... ---------------------------------------------- Error occured while adding the row for Cordyline indivisa. <class 'TypeError'>: Invalid string length for commonname with value toi; mountain cabbage tree; broad-leaved cabbage tree. Expected length to be under 50 but was 53. SKIPPING ROW... ---------------------------------------------- Error occured while adding the row for Cyperus ustulatus. <class 'TypeError'>: Invalid string length for commonname with value giant umbrella sedge; toetoe upokotangata; coastal cutty grass. Expected length to be under 50 but was 62. SKIPPING ROW... ---------------------------------------------- Error occured while adding the row for Festuca actae. <class 'TypeError'>: Invalid json type for field maxheight with value None. Expected '<class 'float'>' but got '<class 'NoneType'>'. SKIPPING ROW... ---------------------------------------------- Error occured while adding the row for Herpolirion novae-zelandiae. <class 'AttributeError'>: 'NoneType' object has no attribute 'split' SKIPPING ROW... ---------------------------------------------- Error occured while adding the row for Ileostylus micranthus. <class 'TypeError'>: Invalid json type for field maxheight with value hemiparasite. Expected '<class 'float'>' but got '<class 'str'>'. SKIPPING ROW... ---------------------------------------------- Error occured while adding the row for Korthalsella clavata. <class 'TypeError'>: Invalid json type for field maxheight with value hemiparasite. Expected '<class 'float'>' but got '<class 'str'>'. SKIPPING ROW... ---------------------------------------------- Error occured while adding the row for Korthalsella lindsayi. <class 'TypeError'>: Invalid json type for field maxheight with value hemiparasite. Expected '<class 'float'>' but got '<class 'str'>'. SKIPPING ROW... ---------------------------------------------- Error occured while adding the row for Korthalsella salicornioides. <class 'TypeError'>: Invalid json type for field maxheight with value hemiparasite. Expected '<class 'float'>' but got '<class 'str'>'. SKIPPING ROW... ---------------------------------------------- Error occured while adding the row for Lepilaena bilocularis. <class 'TypeError'>: Invalid json type for field maxheight with value aquatic. Expected '<class 'float'>' but got '<class 'str'>'. SKIPPING ROW... ---------------------------------------------- Error occured while adding the row for Leptopteris superba. <class 'TypeError'>: Invalid string length for commonname with value crape fern; prince of wales feathers; ngutungutu kiwi. Expected length to be under 50 but was 53. SKIPPING ROW... ---------------------------------------------- Error occured while adding the row for Metrosideros albiflora. <class 'TypeError'>: Invalid json type for field maxheight with value vine. Expected '<class 'float'>' but got '<class 'str'>'. SKIPPING ROW... ---------------------------------------------- Error occured while adding the row for Metrosideros carminea. <class 'TypeError'>: Invalid json type for field maxheight with value vine. Expected '<class 'float'>' but got '<class 'str'>'. SKIPPING ROW... ---------------------------------------------- Error occured while adding the row for Metrosideros colensoi. <class 'TypeError'>: Invalid json type for field maxheight with value vine. Expected '<class 'float'>' but got '<class 'str'>'. SKIPPING ROW... ---------------------------------------------- Error occured while adding the row for Metrosideros diffusa. <class 'TypeError'>: Invalid json type for field maxheight with value vine. Expected '<class 'float'>' but got '<class 'str'>'. SKIPPING ROW... ---------------------------------------------- Error occured while adding the row for Metrosideros fulgens. <class 'TypeError'>: Invalid json type for field maxheight with value vine. Expected '<class 'float'>' but got '<class 'str'>'. SKIPPING ROW... ---------------------------------------------- Error occured while adding the row for Metrosideros parkinsonii. <class 'TypeError'>: Invalid json type for field maxheight with value 7m. Expected '<class 'float'>' but got '<class 'str'>'. SKIPPING ROW... ---------------------------------------------- Error occured while adding the row for Metrosideros perforata. <class 'TypeError'>: Invalid json type for field maxheight with value vine. Expected '<class 'float'>' but got '<class 'str'>'. SKIPPING ROW... ---------------------------------------------- Error occured while adding the row for Myriophyllum pedunculatum. <class 'TypeError'>: Invalid json type for field maxheight with value aquatic. Expected '<class 'float'>' but got '<class 'str'>'. SKIPPING ROW... ---------------------------------------------- Error occured while adding the row for Myriophyllum propinquum. <class 'TypeError'>: Invalid json type for field maxheight with value aquatic. Expected '<class 'float'>' but got '<class 'str'>'. SKIPPING ROW... ---------------------------------------------- Error occured while adding the row for Myriophyllum robustum. <class 'TypeError'>: Invalid json type for field maxheight with value aquatic. Expected '<class 'float'>' but got '<class 'str'>'. SKIPPING ROW... ---------------------------------------------- Error occured while adding the row for Myriophyllum triphyllum. <class 'TypeError'>: Invalid json type for field maxheight with value aquatic. Expected '<class 'float'>' but got '<class 'str'>'. SKIPPING ROW... ---------------------------------------------- Error occured while adding the row for Nasturtium spp. <class 'TypeError'>: Invalid json type for field maxheight with value aquatic. Expected '<class 'float'>' but got '<class 'str'>'. SKIPPING ROW... ---------------------------------------------- Error occured while adding the row for Nothofagus solandri. <class 'TypeError'>: Invalid string length for commonname with value mountain beech (var. cliffortioides); black beech (var. solandri); tawhai rauriki. Expected length to be under 50 but was 81. SKIPPING ROW... ---------------------------------------------- Error occured while adding the row for Parsonsia capsularis. <class 'TypeError'>: Invalid json type for field maxheight with value vine. Expected '<class 'float'>' but got '<class 'str'>'. SKIPPING ROW... ---------------------------------------------- Error occured while adding the row for Parsonsia heterophylla. <class 'TypeError'>: Invalid json type for field maxheight with value vine. Expected '<class 'float'>' but got '<class 'str'>'. SKIPPING ROW... ---------------------------------------------- Error occured while adding the row for Passiflora tetrandra. <class 'TypeError'>: Invalid json type for field maxheight with value vine. Expected '<class 'float'>' but got '<class 'str'>'. SKIPPING ROW... ---------------------------------------------- Error occured while adding the row for Peraxilla colensoi. <class 'TypeError'>: Invalid json type for field maxheight with value hemiparasite. Expected '<class 'float'>' but got '<class 'str'>'. SKIPPING ROW... ---------------------------------------------- Error occured while adding the row for Peraxilla tetrapatela. <class 'TypeError'>: Invalid json type for field maxheight with value hemiparasite. Expected '<class 'float'>' but got '<class 'str'>'. SKIPPING ROW... ---------------------------------------------- Error occured while adding the row for Pittosporum cornifolium. <class 'TypeError'>: Invalid json type for field maxheight with value epiphyte. Expected '<class 'float'>' but got '<class 'str'>'. SKIPPING ROW... ---------------------------------------------- Error occured while adding the row for Potamogeton cheesemanii. <class 'TypeError'>: Invalid json type for field maxheight with value aquatic. Expected '<class 'float'>' but got '<class 'str'>'. SKIPPING ROW... ---------------------------------------------- Error occured while adding the row for Potamogeton ochreatus. <class 'TypeError'>: Invalid json type for field maxheight with value aquatic. Expected '<class 'float'>' but got '<class 'str'>'. SKIPPING ROW... ---------------------------------------------- Error occured while adding the row for Potamogeton pectinatus. <class 'TypeError'>: Invalid json type for field maxheight with value aquatic. Expected '<class 'float'>' but got '<class 'str'>'. SKIPPING ROW... ---------------------------------------------- Error occured while adding the row for Potamogeton suboblongus. <class 'TypeError'>: Invalid json type for field maxheight with value aquatic. Expected '<class 'float'>' but got '<class 'str'>'. SKIPPING ROW... ---------------------------------------------- Error occured while adding the row for Pyrrosia eleagnifolia. <class 'TypeError'>: Invalid json type for field maxheight with value epiphyte. Expected '<class 'float'>' but got '<class 'str'>'. SKIPPING ROW... ---------------------------------------------- Error occured while adding the row for Ripogonum scandens. <class 'TypeError'>: Invalid json type for field maxheight with value vine. Expected '<class 'float'>' but got '<class 'str'>'. SKIPPING ROW... ---------------------------------------------- Error occured while adding the row for Rubus australis. <class 'TypeError'>: Invalid json type for field maxheight with value vine. Expected '<class 'float'>' but got '<class 'str'>'. SKIPPING ROW... ---------------------------------------------- Error occured while adding the row for Rubus cissoides. <class 'TypeError'>: Invalid json type for field maxheight with value vine. Expected '<class 'float'>' but got '<class 'str'>'. SKIPPING ROW... ---------------------------------------------- Error occured while adding the row for Rubus parvus. <class 'TypeError'>: Invalid json type for field maxheight with value None. Expected '<class 'float'>' but got '<class 'NoneType'>'. SKIPPING ROW... ---------------------------------------------- Error occured while adding the row for Rubus schmidelioides. <class 'TypeError'>: Invalid json type for field maxheight with value vine. Expected '<class 'float'>' but got '<class 'str'>'. SKIPPING ROW... ---------------------------------------------- Error occured while adding the row for Ruppia megacarpa. <class 'TypeError'>: Invalid json type for field maxheight with value aquatic. Expected '<class 'float'>' but got '<class 'str'>'. SKIPPING ROW... ---------------------------------------------- Error occured while adding the row for Ruppia polycarpa. <class 'TypeError'>: Invalid json type for field maxheight with value aquatic. Expected '<class 'float'>' but got '<class 'str'>'. SKIPPING ROW... ---------------------------------------------- Error occured while adding the row for Scandia rosifolia. <class 'TypeError'>: Invalid json type for field maxheight with value vine. Expected '<class 'float'>' but got '<class 'str'>'. SKIPPING ROW... ---------------------------------------------- Error occured while adding the row for Tupeia antarctica. <class 'TypeError'>: Invalid json type for field maxheight with value mistletoe. Expected '<class 'float'>' but got '<class 'str'>'. SKIPPING ROW... ---------------------------------------------- Error occured while adding the row for Zannichellia palustris. <class 'TypeError'>: Invalid json type for field maxheight with value aquatic. Expected '<class 'float'>' but got '<class 'str'>'. SKIPPING ROW... ---------------------------------------------- ```

danalambert commented 2021-10-15 15:22:42 +13:00 (Migrated from gitlab.catalyst.net.nz)

Copy link

marked the checklist item Create db schema design as completed

marked the checklist item **Create db schema design** as completed

danalambert commented 2021-10-15 15:22:44 +13:00 (Migrated from gitlab.catalyst.net.nz)

Copy link

marked the checklist item Create django models to reflect schema as completed

marked the checklist item **Create django models to reflect schema** as completed

danalambert commented 2021-10-15 15:23:21 +13:00 (Migrated from gitlab.catalyst.net.nz)

Copy link

I'm leaving habitat and zone data ingestion for a later date once we have a better idea of what is required for this.

I'm leaving habitat and zone data ingestion for a later date once we have a better idea of what is required for this.

danalambert commented 2021-10-15 15:23:27 +13:00 (Migrated from gitlab.catalyst.net.nz)

Copy link

marked the checklist item Import and injest plant data from excel spreadsheet as completed

marked the checklist item **Import and injest plant data from excel spreadsheet** as completed

danalambert commented 2021-10-15 15:23:28 +13:00 (Migrated from gitlab.catalyst.net.nz)

Copy link

marked the checklist item Import and injest soil data from shapefile as completed

marked the checklist item **Import and injest soil data from shapefile** as completed

danalambert commented 2021-10-15 15:23:38 +13:00 (Migrated from gitlab.catalyst.net.nz)

Copy link

changed the description

changed the description

danalambert commented 2021-10-15 15:23:41 +13:00 (Migrated from gitlab.catalyst.net.nz)

Copy link

marked the checklist item Import and injest eco region data as completed

marked the checklist item **Import and injest eco region data** as completed

danalambert commented 2021-10-15 15:23:42 +13:00 (Migrated from gitlab.catalyst.net.nz)

Copy link

marked the checklist item Create a command that populates the database with the given data as completed

marked the checklist item **Create a command that populates the database with the given data** as completed

danalambert commented 2021-10-15 15:23:43 +13:00 (Migrated from gitlab.catalyst.net.nz)

Copy link

marked the checklist item Document process as completed

marked the checklist item **Document process** as completed

danalambert commented 2021-10-15 15:28:26 +13:00 (Migrated from gitlab.catalyst.net.nz)

Copy link

mentioned in merge request !3

mentioned in merge request !3

alistairmcintyre (Migrated from gitlab.catalyst.net.nz) closed this issue 2021-10-20 14:05:07 +13:00

Sign in to join this conversation.

No Branch/Tag specified

Branches Tags

main

v1.0.1

No results found.

Labels

Clear labels   

Bug

A software bug we've noticed. (These may not necessarily be show-stoppers)

  

Client: Biosphere Capital

  

Client: Central Hawkes Bay District Council

  

Client: Forward Works Viewer

  

Client: Kea/Kākā Databases

  

Client: Otorohanga District Council

  

Stage: Blocked

Something is causing us to be unable to currently fix this issue.

  

Stage: Doing

An issue that's assigned and being worked on

  

Stage: Peer review / Staging

An issue waiting to be given the all clear for production deployment.

  

Stage: Ready

For tickets that have been quanitifed, have acceptance criteria, and can be safely moved to the To Do column.

  

Stage: UAT AT

Work waiting to be deployed to production.

No labels

Bug

Client: Biosphere Capital

Client: Central Hawkes Bay District Council

Client: Forward Works Viewer

Client: Kea/Kākā Databases

Client: Otorohanga District Council

Stage: Blocked

Stage: Doing

Stage: Peer review / Staging

Stage: Ready

Stage: UAT AT

Milestone

Clear milestone

No items

No milestone

Projects

Clear projects

No items

No project

Assignees

Clear assignees

No assignees

1 participant

Notifications

Subscribe

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference: lightweight/right-tree#3

No description provided.