In [7]:
#load csv dataframe
import pandas as pd
import py_entitymatching as em
import math
import matplotlib.pyplot as plt
import numpy as np
from matplotlib import style
import re

# Read in original tables
rl = em.read_csv_metadata("../finalRedlist.csv", encoding="ISO-8859-1", key='id')
ar = em.read_csv_metadata("../finalArkives.csv", encoding="ISO-8859-1", key='id')
rl['block'] = 'yes'
ar['block'] = 'yes'

G = em.read_csv_metadata("to_label.csv", ltable=rl, rtable=ar, encoding="ISO-8859-1")
G1 = G[:200]
G1


Metadata file is not present in the given path; proceeding to read the csv file.
Metadata file is not present in the given path; proceeding to read the csv file.
Out[7]:
_id ltable_id rtable_id ltable_name ltable_genus ltable_family ltable_ecology ltable_countries ltable_threat_paragraph ltable_conservation_paragraph ... rtable_family rtable_genus rtable_size rtable_threats rtable_conservation rtable_threat_keywords rtable_conservation_keywords rtable_tCount rtable_cCount rtable_block
0 2985534 6308 1578 dark red meranti Shorea Dipterocarpaceae Terrestrial Indonesia (Kalimantan); Malaysia (Sarawak); NaN ['\n Some subpopulations occur in forest reserves.\n\n \n '] ... Dipterocarpaceae Shorea Height: up to 50 m (2)Trunk diameter: up to 182 cm (2) Numbers of white lauan have become depleted due to logging and <strong>slash-and-burn</strong> a... The white lauan most likely occurs in a number of protected areas throughout the Philippines suc... protected; 0 1.0 yes
1 2764025 5446 1461 vanikoro flying fox Pteropus Pteropodidae Terrestrial Solomon Islands; \r\n This island was extensively logged in the 1950s and 1960s; there is some regeneration no... ['\n It is listed on Appendix II of CITES. It is not known if this species is present in any ... ... Pteropodidae Pteropus 350 g (2) This species is in grave danger of extinction in the wild on Rodrigues Island as a result of hab... In 1976 the Rodrigues fruit bats were on the brink of extinction. This speciesâ?? survival in th... loss;hunting; captive breeding; 2 1.0 yes
2 2075992 6618 1097 catalina mahogany Cercocarpus Rosaceae NaN United States (California); NaN NaN ... Rosaceae Cercocarpus Height: 3 - 7 m (2)Trunk diameter: c. 20 cm (2) Historically a major threat to the Catalina mahogany was the introduction of <strong>herbivores<... Conservation efforts began in the 1970s with a detailed inventory of the remaining Catalina maho... loss;invasive; 2 0.0 yes
3 1360833 5152 719 attenborough's pitcher plant Nepenthes Nepenthaceae Terrestrial Philippines; \r\n The main threat to this species is from poaching; the mountain is relatively inaccessibl... ['\n There are no ', <span style="font-style: italic;">in situ</span>, " conservation measure... ... Nepenthaceae Nepenthes Height: up to 15 m (2) <i>Nepenthes</i> species are threatened by a combination of over-collection and habitat loss (2)... <i>Nepenthes burbidgeae</i> is found only on Mount Kinabalu which is situated within Kinabalu Na... loss;environmental;environment; cites;protected; 3 2.0 yes
4 1477807 4420 781 black web-fotted salamander , cordillera central salamander Bolitoglossa Plethodontidae Terrestrial Costa Rica; \r\n Outside of protected areas the main threat to it is habitat loss due to the destruction ... ['\n It has been recorded from the Zona Protectora Cerros de Escazu and from the Reserva Fore... ... Plethodontidae Bolitoglossa Snout-vent length: 51 - 68 mm (2) (3)Tail length: c. 51 mm (2) Salvinâ??s mushroomtongue salamander was once relatively common but has undergone a decline as a... No specific conservation measures are currently known to be in place for Salvinâ??s mushroomtong... loss;fragmentation;environment;disease; protected; 4 1.0 yes
5 923422 2080 488 commoner lignum vitae, guaiac tree Guaiacum Zygophyllaceae Terrestrial Thailand; Anguilla; Antigua and Barbuda; Bahamas; Barbados; Bonaire, Sint Eustatius and Saba (Sa... \r\n The timber and medicinal resin have been traded for several centuries as lignum-vitae an... ['\n The species is listed in Appendix II of ', <a href="http://www.cites.org/">CITES</a>, '.... ... Zygophyllaceae Guaiacum Height: up to 10 m (3) (4) The main threat the holywood lignum vitae faces is over harvesting. The tree is sought after for... The holywood lignum vitae is included on the convention on the Convention on International Trade... loss; cites;protected; 1 2.0 yes
6 1812222 2777 958 bornean agile gibbon, bornean white-bearded gibbon Hylobates Hylobatidae Terrestrial Indonesia (Kalimantan); \r\n This species was certainly affected by fires of 1990s and continuing deforestation (lega... ['\n Bornean white-bearded gibbons are protected throughout their range by Indonesian law and... ... Hylobatidae Hylobates Head-body length: 45-50 cm (2)Male weight: c. 5.7 kg (3)Female weight: c.5.3 kg (3) Rapid loss of habitat poses the principle threat to gibbons placing their future in great peril ... The white-handed gibbon is protected from international trade by its listing on Appendix I of th... loss;pet; cites;protected; 2 2.0 yes
7 1737633 7436 918 short-nosed green frog, shortsnout robber frog Eleutherodactylus Eleutherodactylidae Terrestrial Haiti; \r\n Severe habitat destruction is taking place in its range, primarily due to logging by loc... ['\n Although it occurs in the Parc National Macaya, there is no active management of this ar... ... Leptodactylidae Eleutherodactylus Female snout-vent length: up to 34 mm (2) Currently almost a quarter of all amphibian species on the British Virgin Islands are categorise... A number of conservation recommendations have been made to protect the native fauna of the Briti... protected; 0 1.0 yes
8 1836506 1107 971 patternless whistling frog Eleutherodactylus Eleutherodactylidae Terrestrial Haiti; \r\n Severe deforestation is taking place within its range in Haiti due to charcoaling and sl... ['\n', <p>It occurs within the de la Hotte Biosphere, although improved site management is requi... ... Leptodactylidae Eleutherodactylus Female snout-vent length: 2 cm (2) Already restricted in range Wightmanâ??s robber frog populations are in a continuing decline est... Despite not being the target of any known conservation measures Wightmanâ??s robber frog is affo... disease;pollution; protected; 2 1.0 yes
9 2506562 4480 1325 minor black millipede Doratogonus Spirostreptidae Terrestrial South Africa (KwaZulu-Natal); NaN NaN ... Spirostreptidae Doratogonus NaN The single tiny forest area in which the major black millipede occurs is under threat from the e... The Gwaliweni Forest is managed by KZN Wildlife although wood extraction there continues (1). No... 0 0.0 yes
10 2664057 6257 1408 light red meranti Shorea Dipterocarpaceae Terrestrial Indonesia (Kalimantan); Malaysia (Sabah, Sarawak); \r\n Threatened by rates of exploitation. It is the major source of light red meranti timber ... ['\n Subpopulations are found in some forest reserves.\n\n \n '] ... Dipterocarpaceae Shorea Height: 70 m (2)Trunk diameter: 1.6 m (2) The Philippine mahogany has become depleted due to logging and <strong>slash-and-burn</strong> f... Despite being Critically Endangered it is not clear whether any conservation measures exist for ... 0 0.0 yes
11 1737660 7500 918 schmidt's robber frog Eleutherodactylus Eleutherodactylidae Terrestrial; Freshwater Dominican Republic; Haiti; \r\n In the Cordillera Central, habitat destruction is taking place as a result of agricultur... ['\n The range of the species includes several protected areas, but there is very little mana... ... Leptodactylidae Eleutherodactylus Female snout-vent length: up to 34 mm (2) Currently almost a quarter of all amphibian species on the British Virgin Islands are categorise... A number of conservation recommendations have been made to protect the native fauna of the Briti... protected; 0 1.0 yes
12 508026 5270 268 deccan barb Puntius Cyprinidae Freshwater India (Maharashtra); \r\n The upper lake is affected by domestic waste and detergents, and organic pollution. The ... ['\n There is a need to determine the taxonomic validity of the species as well as its distri... ... Cyprinidae Puntius Maximum length: 15 cm (2) One of Indiaâ??s most celebrated ornamental fishes the Denison barb has suffered huge declines a... A conservation priority for the recovery of the Denison barb is to reduce the number of fish cau... fishing;pet; 2 0.0 yes
13 1094610 7224 578 marohita mouse lemur Microcebus Cheirogaleidae Terrestrial Madagascar; \r\n This species is threatened by habitat loss and degradation from unsustainable agricultur... ['\n Field studies and additional regional surveys are urgently needed to determine at least ... ... Cheirogaleidae Microcebus 30 g (3) Like many Madagascan species Madame Bertheâ??s mouse lemur is threatened by habitat loss due to ... While there are no known conservation measures specifically directed towards Madame Bertheâ??s m... loss; 1 0.0 yes
14 1253136 5483 662 bithynian spined loach Cobitis Cobitidae Freshwater Turkey (Turkey-in-Asia); \r\n Exploitation of rivers for hydropowers as well as pollution are the major threats for fr... ['\n', <p><span class="st"><span lang="EN-GB">There is no conservation action in place for this ... ... Cobitidae Cobitis Length: up to 8.2 cm (2) The Northern Iberian spined-loach has declined in abundance and range in recent decades and has ... The Northern Iberian spined-loach is listed as Vulnerable in the Spanish Red Book (3) and as End... disease;pet;pollution; 3 0.0 yes
15 1095107 675 579 endo's pipistrelle Pipistrellus Vespertilionidae Terrestrial Japan; \r\n Destruction of primary lowland forest, upon which the species depends for roosting in tr... ['\n It is present in protected areas. They are a\n\n \n '] ... Vespertilionidae Pipistrellus 2.9 - 5.7 g (2) Although the Madeira pipistrelle is seemingly well adapted to man-made or human influenced habit... The Madeira pipistrelle is protected through the Bern Convention (11) and by its listing on Anne... loss; protected; 1 1.0 yes
16 2665002 1819 1409 dark red meranti Shorea Dipterocarpaceae Terrestrial Brunei Darussalam; Indonesia (Kalimantan); Malaysia (Sabah, Sarawak); NaN ['\n Some subpopulations are known to occur in forest reserves.\n\n \n '] ... Dipterocarpaceae Shorea Height: 70 m (2)Trunk diameter: 1.6 m (2) The Philippine mahogany has become depleted due to logging and <strong>slash-and-burn</strong> f... Despite being Critically Endangered it is not clear whether any conservation measures exist for ... 0 0.0 yes
17 1407132 698 744 terre-de-haut racer Alsophis Dipsadidae Terrestrial Guadeloupe; \r\n This species is threatened by habitat loss due to urban development, particularly for th... ['\n This species currently has no conservation measures in place for it. Further research in... ... Colubridae Alsophis Maximum snout-vent length: 92 cm (2) The red-bellied racer now occupies only 11 percent of its original range (5) largely due to the ... Fortunately there are some systems in place to conserve the red-bellied racer. For example on St... protected; 0 1.0 yes
18 542932 661 287 decary's leaf chameleon Brookesia Chamaeleonidae Terrestrial Madagascar; \r\n The major threats to the species include bush fires, cattle grazing, and deforestation f... ['\n', <p>This species is protected under Malagasy law but collection from the wild is permitted... ... Chamaeleonidae Brookesia 0.5 g (2) There are few threats to the dwarf chameleon. There is very low commercial demand for this tiny ... The dwarf chameleon occurs in the Tsingy de Bemaraha National Park and probably also the Bemarah... cites;protected; 0 2.0 yes
19 892708 510 472 splendid partulina Partulina Achatinellidae NaN United States (Hawaiian Is.); NaN NaN ... Achatinellidae Partulina NaN As a result of human disturbances the Hawaiian Islands have seen devastating extinction rates an... Like many other Hawaiian snail species the restricted geographic range and small population size... loss; captive breeding; 1 1.0 yes
20 1867844 5743 987 duskytail darter Etheostoma Percidae Freshwater United States; \r\n Impoundments, siltation associated with poor land-use practices, coal mining, and loggin... ['\n "Propagation may help ensure the survival of the species and translocation outside Coppe... ... Percidae Etheostoma Length: c. 5 cm (2)Maximum length: 6.4 cm (3) Although once abundant the yellowcheek darter population has undergone a rapid decline decreasin... Having suffered such a severe decline the yellowcheek darter is in drastic need of major conserv... loss; captive breeding;endangered species act; 1 2.0 yes
21 2191518 7550 1158 guerreran leopard frog Lithobates Ranidae Terrestrial; Freshwater Mexico; \r\n Although generally affected by habitat loss, the most likely cause of the extinction of ... ['\n A survey of the Omiltemi State Park is recommended in order to confirm whether or not th... ... Ranidae Lithobates Length: 5.6 - 10.5 cm (2) The dusky gopher frog has disappeared from most of its former range due to the loss and alterati... The dusky gopher frog is listed as Endangered under the U.S. Endangered Species Act (16) and is ... loss;environment;disease; captive breeding;protected;endangered species act; 3 3.0 yes
22 1054834 6389 557 light red meranti Shorea Dipterocarpaceae Terrestrial Malaysia (Peninsular Malaysia, Sarawak); NaN ["\n It is protected under Sarawak's Wildlife Protection Bill (1990) as a major source of ill... ... Dipterocarpaceae Shorea Height: up to 60 m (2) Light red meranti has been heavily exploited for its valuable timber leaving populations of this... The light red meranti is known to occur in some forest reserves (1). 0 0.0 yes
23 443150 2816 234 santa marta white-fronted capuchin Cebus Cebidae NaN Colombia (Colombia (mainland)); NaN NaN ... Cebidae Cebus Male head-body length: 40 - 55 cm (2)Female head-body length: 30 - 40 cm (2)Tail length: 30 - 50... The main threat that the crested capuchin faces is the fragmentation and destruction of its natu... There are several protected areas within the range of the crested capuchin such as the Linhares ... fragmentation; cites;protected; 1 2.0 yes
24 502638 6250 265 red balau Shorea Dipterocarpaceae Terrestrial Brunei Darussalam; Malaysia (Sarawak); \r\n Threatened by logging for its valuable construction timber, semayur. It is unlikely to s... NaN ... Dipterocarpaceae Shorea Trunk diameter: up to 172 cm (2) Dipterocarp forests have become amongst the most endangered in the world widely logged for use i... Some subpopulations of this species are found in primary forest reserves where they receive vary... 0 0.0 yes
25 757669 5387 400 perrierå_åÑ̬s sifaka Propithecus Indriidae Terrestrial Madagascar; \r\n Slash-and-burn activities resulting in forest loss represents the greatest threat to thi... ['\n This species is listed on Appendix I of CITES. ', <span lang="EN-CA">One of the rarest a... ... Indriidae Propithecus 3.5 kg (2) Of all lemurs the golden-crowned sifaka has one of the most limited distributions (3). Vast trac... Recent studies have shown that these sifakas are fairly abundant in some of the remaining forest... loss;hunting; protected; 2 1.0 yes
26 2663126 2004 1408 dark red meranti Shorea Dipterocarpaceae Terrestrial Indonesia (Sumatera); NaN ['\n Some subpopulations are found in primary forest reserves.\n\n \n '] ... Dipterocarpaceae Shorea Height: 70 m (2)Trunk diameter: 1.6 m (2) The Philippine mahogany has become depleted due to logging and <strong>slash-and-burn</strong> f... Despite being Critically Endangered it is not clear whether any conservation measures exist for ... 0 0.0 yes
27 724937 3185 383 golden vietnamese cypress Xanthocyparis Cupressaceae Terrestrial China (Guangxi); Viet Nam; \r\n Wood cutting is the main threat. The wood of Cupressaceous conifers, as well as its fol... ['\n In Viet Nam the majority of the national population occurs with the Bat Dai Son and Na H... ... Cupressaceae Xanthocyparis Height: 10 - 15 m (1) Due to the expansion of agriculture in the local area the habitat of the golden Vietnamese cypre... There are currently no specific conservation measures in place to protect the golden Vietnamese ... protected; 0 1.0 yes
28 2987414 6252 1579 red balau Shorea Dipterocarpaceae Terrestrial Indonesia (Kalimantan, Sumatera); Malaysia (Peninsular Malaysia, Sabah, Sarawak); \r\n Felled for its valued red balau or red meranti timber.\r\n\r\n \r\n ['\n Some subpopulations of the species occur in forest reserves.\n\n \n '] ... Dipterocarpaceae Shorea Height: up to 50 m (2)Trunk diameter: up to 182 cm (2) Numbers of white lauan have become depleted due to logging and <strong>slash-and-burn</strong> a... The white lauan most likely occurs in a number of protected areas throughout the Philippines suc... protected; 0 1.0 yes
29 1866889 1380 987 bluemask darter Etheostoma Percidae Freshwater United States; \r\n Some areas were inundated by the Great Falls Reservoir in the 1910s. The habitat continu... ['\n Because much of the presumed historic habitat has been impounded or otherwise altered, i... ... Percidae Etheostoma Length: c. 5 cm (2)Maximum length: 6.4 cm (3) Although once abundant the yellowcheek darter population has undergone a rapid decline decreasin... Having suffered such a severe decline the yellowcheek darter is in drastic need of major conserv... loss; captive breeding;endangered species act; 1 2.0 yes
... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ...
170 504524 6242 266 dark red meranti Shorea Dipterocarpaceae Terrestrial Brunei Darussalam; Malaysia (Sarawak); NaN ['\n Some subpopulations also occur in forest reserves.\n\n \n '] ... Dipterocarpaceae Shorea Trunk diameter: up to 172 cm (2) Dipterocarp forests have become amongst the most endangered in the world widely logged for use i... Some subpopulations of this species are found in primary forest reserves where they receive vary... 0 0.0 yes
171 502633 6242 265 dark red meranti Shorea Dipterocarpaceae Terrestrial Brunei Darussalam; Malaysia (Sarawak); NaN ['\n Some subpopulations also occur in forest reserves.\n\n \n '] ... Dipterocarpaceae Shorea Trunk diameter: up to 172 cm (2) Dipterocarp forests have become amongst the most endangered in the world widely logged for use i... Some subpopulations of this species are found in primary forest reserves where they receive vary... 0 0.0 yes
172 2665914 6102 1409 yellow meranti Shorea Dipterocarpaceae NaN Malaysia (Sarawak); NaN NaN ... Dipterocarpaceae Shorea Height: 70 m (2)Trunk diameter: 1.6 m (2) The Philippine mahogany has become depleted due to logging and <strong>slash-and-burn</strong> f... Despite being Critically Endangered it is not clear whether any conservation measures exist for ... 0 0.0 yes
173 976400 2777 516 bornean agile gibbon, bornean white-bearded gibbon Hylobates Hylobatidae Terrestrial Indonesia (Kalimantan); \r\n This species was certainly affected by fires of 1990s and continuing deforestation (lega... ['\n Bornean white-bearded gibbons are protected throughout their range by Indonesian law and... ... Hylobatidae Hylobates 5.9 kg (4) The Javan gibbon has undergone a dramatic population decline principally as a result of habitat ... In light of the status of this species in the wild a Javan gibbon rescue and rehabilitation work... pet; protected; 1 1.0 yes
174 501705 1984 265 white meranti Shorea Dipterocarpaceae Terrestrial Cambodia; India (Andhra Pradesh, Karnataka, Kerala, Tamil Nadu); Lao People's Democratic Republi... NaN ['\n Some subpopulations are recorded in forest reserves.\n\n \n '] ... Dipterocarpaceae Shorea Trunk diameter: up to 172 cm (2) Dipterocarp forests have become amongst the most endangered in the world widely logged for use i... Some subpopulations of this species are found in primary forest reserves where they receive vary... 0 0.0 yes
175 281611 7563 148 sacred grove bushfrog, sacred grove bush frog Philautus Rhacophoridae Terrestrial India; \r\n The main threat is believed to be the loss of suitable habitat due to harvesting of wood... ["\n The type locality is a sacred grove, which is relatively small and does not guarantee pr... ... Rhacophoridae Philautus Male snout-vent length: 2.3 - 3 cm (2) The blue-eyed bush frog has lost a great amount of suitable habitat due to dam construction agri... Some areas within the range of the blue-eyed bush frog are protected including the Sharavathi Va... invasive; protected; 1 1.0 yes
176 2898898 7899 1532 table mountain ghost frog Heleophryne Heleophrynidae Terrestrial; Freshwater South Africa (Western Cape); \r\n The main threats are the spread of alien vegetation, frequent fires, and water storage r... ["\n The whole of this species' range is incorporated in the Table Mountain National Park, pa... ... Heleophrynidae Heleophryne Female snout-vent length: 60 mm (2)Male snout-vent length: 50 mm (2) Despite occurring within protected land the Table Mountain ghost frog is still subject to a numb... The whole of the Table Mountain ghost frogâ??s range is incorporated within the Table Mountain N... disease; 1 0.0 yes
177 1907926 7644 1008 anegada ground iguana, anegada island iguana, anegada rock iguana Cyclura Iguanidae Terrestrial Virgin Islands, British; \r\n Areas on Anegada that once contained dense populations of iguanas now support few or non... ['\n A major grant has been received from the Environment, Science and Energy Department of t... ... Iguanidae Cyclura Male snout-to-vent length: to 560 mmFemale snout-to-vent length: to 500 mmMale weight: 7.75 kgFe... Anegada ground iguana populations have undergone a drastic decline in recent decades leaving pos... The Anegada Iguana Recovery Programme began in 1997 which included establishing a â??headstartâ?... loss;poaching;pet; protected; 3 1.0 yes
178 374334 7679 197 ebner's skink Chalcides Scincidae Terrestrial Morocco; \r\n This species has a restricted range, and is highly threatened by habitat loss principall... ['\n There is a need to survey more widely for this species. It is not known to occur in any ... ... Scincidae Chalcides Chalcides (1) Perhaps the most threatened skink species in the Canaries (5) <em>Chalcides simonyi</em> has a s... Although <em>Chalcides simonyi</em> has not been the target of any known conservation measures i... loss; protected; 1 1.0 yes
179 2665923 6123 1409 yellow meranti Shorea Dipterocarpaceae Terrestrial Indonesia (Kalimantan, Sumatera); Malaysia (Peninsular Malaysia); NaN NaN ... Dipterocarpaceae Shorea Height: 70 m (2)Trunk diameter: 1.6 m (2) The Philippine mahogany has become depleted due to logging and <strong>slash-and-burn</strong> f... Despite being Critically Endangered it is not clear whether any conservation measures exist for ... 0 0.0 yes
180 2985540 6328 1578 light red meranti Shorea Dipterocarpaceae Terrestrial Brunei Darussalam; Malaysia (Sabah, Sarawak); NaN ['\n Sometimes within primary forest reserves.\n\n \n '] ... Dipterocarpaceae Shorea Height: up to 50 m (2)Trunk diameter: up to 182 cm (2) Numbers of white lauan have become depleted due to logging and <strong>slash-and-burn</strong> a... The white lauan most likely occurs in a number of protected areas throughout the Philippines suc... protected; 0 1.0 yes
181 2134199 4918 1128 black crested macaque, celebes black macaque, celebes crested macaque, celebes macaque, crested ... Macaca Cercopithecidae Terrestrial Indonesia (Maluku - Introduced, Sulawesi); \r\n There is extensive habitat loss within its range. Hunting for bush meat is a major threa... ['\n This species is listed under CITES Appendix II. It occurs in several protected areas (Gu... ... Cercopithecidae Macaca Male head-body length: 48 â?? 60 cm (2)Female head-body length: 44 â?? 55 cm (2)Tail length: 1 â... This primate is threatened by over-hunting for food in Sulawesi where its meat is considered a d... International trade in this species is prohibited by its listing on Appendix II of the Conventio... hunting; cites;captive breeding; 1 2.0 yes
182 2965922 4108 1568 amable maria frog Telmatobius Telmatobiidae Terrestrial; Freshwater Peru; \r\n The main threat to the species is exploitation for food and medicine.\r\n\r\n \r\n ['\n It occurs in the Reserva Nacional de Junin. Measures are urgently required to control an... ... Leptodactylidae Telmatobius Length: 5 cm (2) <em>Telmatobius espadai </em>is now an extremely rare species; a population census undertaken in... Despite <em>Telmatobius espadai </em>being classified as Critically Endangered by the IUCN Red L... disease; 1 0.0 yes
183 674647 5818 356 delacour's langur Trachypithecus Cercopithecidae Terrestrial Viet Nam; \r\n Hunting for the purposes of traditional "medicine" is the primary threat facing this spe... ["\n This species is currently listed only as CITES Appendix II. It is considered 'endangered... ... Cercopithecidae Trachypithecus Head-body length: 49 - 59 cm (2) (3)Tail length: 72 - 84 cm (2) (3) Although a relatively widespread species Germainâ??s langur is very rare throughout most of its ... Germainâ??s langur occurs in a number of protected areas including Phu Quoc and Cat Tien Nationa... loss;hunting;pet; cites;protected; 3 2.0 yes
184 1475916 4420 780 black web-fotted salamander , cordillera central salamander Bolitoglossa Plethodontidae Terrestrial Costa Rica; \r\n Outside of protected areas the main threat to it is habitat loss due to the destruction ... ['\n It has been recorded from the Zona Protectora Cerros de Escazu and from the Reserva Fore... ... Plethodontidae Bolitoglossa Snout-vent length: 51 - 68 mm (2) (3)Tail length: c. 51 mm (2) Salvinâ??s mushroomtongue salamander was once relatively common but has undergone a decline as a... No specific conservation measures are currently known to be in place for Salvinâ??s mushroomtong... loss;fragmentation;environment;disease; protected; 4 1.0 yes
185 1451910 6203 767 candelabra tree, parana pine, paranåÕå?-pine Araucaria Araucariaceae NaN Argentina (Misiones); Brazil (Minas Gerais, ParanåÕå?, Rio Grande do Sul, Santa Catarina, SåÕå£o... \r\n ParanåÕå? Pine is the most important timber species in Brazil. In addition to the massiv... ['\n Since 2001 there has been an official Brazilian ban on log exports of this species. The ... ... Araucariaceae Araucaria Height: up to 30 m (2) (3)Trunk diameter: up to 0.6 m (2) As on many Pacific islands the native vegetation of New Caledonia has been significantly modifie... New Caledonia is considered a biodiversity â??hotspotâ?? having for its size a remarkably unique... loss;invasive; protected; 2 1.0 yes
186 1384854 2775 732 shortridgeå_åÑ̬s capped langur, shortridgeå_åÑ̬s langur Trachypithecus Cercopithecidae Terrestrial China; Myanmar; \r\n These animals are hunted for food and traditional å_åÑåÒmedicine,å_åÑå? sometimes as ill... ['\n This species is listed in CITES Appendix I. In Myanmar it is a protected species under t... ... Cercopithecidae Trachypithecus Male head-body length: 50 â?? 65 cm (2)Female head-body length: 45 â?? 60 cm (2)Male tail length... The purple-faced langurâ??s range has contracted greatly in the face of human encroachment. Defo... The commercial exploitation of purple-faced langurs is regulated by their listing on Appendix II... loss;fragmentation;hunting; cites;protected; 3 2.0 yes
187 1582612 7538 836 social tuco-tuco Ctenomys Ctenomyidae Terrestrial Argentina; \r\n Habitat disturbance by grazing sheep is the main threat to this species.\r\n\r\n \r\n ['\n This species occurs in the Reserva Nacional del Parque Nacional Nahuel Huapi (Woods and ... ... Ctenomyidae Ctenomys 250 - 600g (2) The main threat to the southern tuco-tuco is the loss of its costal habitat a consequence of bot... There are currently no known specific conservation measures in place to protect the southern tuc... loss; 1 0.0 yes
188 2178389 7838 1151 delta green ground beetle Elaphrus Carabidae NaN United States; NaN NaN ... Carabidae Elaphrus Length: 6 mm (2). The historical distribution of the delta ground beetle is unknown but it is thought reasonable t... The delta green ground beetle is protected by the Lacey Act which prohibits its import export tr... protected; 0 1.0 yes
189 1153819 1036 610 banks flying fox Pteropus Pteropodidae Terrestrial Vanuatu; \r\n This species has a restricted range. It is threatened by hunting for food (K. Helgen and... ['\n This species is listed on Appendix II of CITES. It is not believed to be present in any ... ... Pteropodidae Pteropus Wingspan: 80 cm (2)Forearm length: 14.3 - 16.5 cm (3)Female weight: 380 - 540 g (3) The Mauritian flying fox is threatened by ongoing habitat loss in the form of deforestation (1) ... The Mauritian flying fox has been officially protected in Mauritius since 1993 and is reported t... loss; cites;captive breeding;protected; 1 3.0 yes
190 1382964 2776 731 germainå_åÑ̬s langur, germainå_åÑ̬s silver langur, indochinese lutung, indochinese silvered la... Trachypithecus Cercopithecidae Terrestrial Cambodia; Lao People's Democratic Republic; Myanmar; Thailand; Viet Nam; \r\n The major threats to this species are hunting, mainly for subsistence use and traditiona... ['\n This species is listed on CITES Appendix II. It has been recorded from Phu Quoc National... ... Cercopithecidae Trachypithecus Male head-body length: 50 â?? 65 cm (2)Female head-body length: 45 â?? 60 cm (2)Male tail length... The purple-faced langurâ??s range has contracted greatly in the face of human encroachment. Defo... The commercial exploitation of purple-faced langurs is regulated by their listing on Appendix II... loss;fragmentation;hunting; cites;protected; 3 2.0 yes
191 2987405 6240 1579 light red meranti, philippine mahogany, white lauan Shorea Dipterocarpaceae Terrestrial Malaysia (Sabah, Sarawak); Philippines; NaN NaN ... Dipterocarpaceae Shorea Height: up to 50 m (2)Trunk diameter: up to 182 cm (2) Numbers of white lauan have become depleted due to logging and <strong>slash-and-burn</strong> a... The white lauan most likely occurs in a number of protected areas throughout the Philippines suc... protected; 0 1.0 yes
192 2136648 7474 1129 cuban crocodile Crocodylus Crocodylidae Terrestrial; Freshwater Cuba; \r\n There are two main threats: illicit hunting and hybridization with native American Croco... ['\n This species is listed under Appendix I of CITES. There are also direct conservation mea... ... Crocodylidae Crocodylus 130 kg (2) The Cuban crocodile is highly vulnerable due to the restricted nature of its distribution (5). H... Recent reports indicated that population numbers of the Cuban crocodile are showing signs of rec... pet; cites;protected; 1 2.0 yes
193 863410 4837 456 maranhåÕå£o red-handed howler, maranhåÕå£o red-handed howler monkey, red-handed howling monkey Alouatta Atelidae Terrestrial Brazil (CearåÕå?, MaranhåÕå£o, PiauåÕ_); \r\n Very few populations still survive in a region which has a long history of human occupat... ['\n This species occurs in the LenåÕ_ois Maranhenses National Park, MaranhåÕå£o (157,261 ha)... ... Atelidae Alouatta Male head-and-body length: 67 - 71 cm (2)Female head-and-body length: 52 - 64 cm (2)Male tail le... The Guatemalan black howler is threatened throughout most of its range from hunting and habitat ... The Guatemalan black howler is known to occur in six protected areas: Cockscomb Basin Wildlife S... hunting; protected; 1 1.0 yes
194 2665971 6439 1409 dark red meranti Shorea Dipterocarpaceae NaN Brunei Darussalam; Malaysia (Sabah); NaN NaN ... Dipterocarpaceae Shorea Height: 70 m (2)Trunk diameter: 1.6 m (2) The Philippine mahogany has become depleted due to logging and <strong>slash-and-burn</strong> f... Despite being Critically Endangered it is not clear whether any conservation measures exist for ... 0 0.0 yes
195 2966818 7524 1568 titicaca water frog Telmatobius Telmatobiidae Freshwater Bolivia, Plurinational States of; Peru; \r\n Major threats include over-harvesting of adults, the presumed predation of larvae by int... ['\n It is present in the Lake Titicaca Reserve, but measures are needed to maintain suitable... ... Leptodactylidae Telmatobius Length: 5 cm (2) <em>Telmatobius espadai </em>is now an extremely rare species; a population census undertaken in... Despite <em>Telmatobius espadai </em>being classified as Critically Endangered by the IUCN Red L... disease; 1 0.0 yes
196 2664046 6242 1408 dark red meranti Shorea Dipterocarpaceae Terrestrial Brunei Darussalam; Malaysia (Sarawak); NaN ['\n Some subpopulations also occur in forest reserves.\n\n \n '] ... Dipterocarpaceae Shorea Height: 70 m (2)Trunk diameter: 1.6 m (2) The Philippine mahogany has become depleted due to logging and <strong>slash-and-burn</strong> f... Despite being Critically Endangered it is not clear whether any conservation measures exist for ... 0 0.0 yes
197 1066603 175 564 nilgiri long-tailed tree mouse Vandeleuria Muridae Terrestrial India; \r\n Human disturbance, use of pesticides and exotic trees are found to be major threats to t... ['\n It is listed as a vermin under Schedule V of the Indian Wildlife (Protection) Act. It ha... ... Muridae Vandeleuria c. 10 g (2) Occupying an area no more than 500 square kilometres the long-tailed climbing mouse is threatene... There are currently no conservation measures in place for the long-tailed climbing mouse and it ... loss;fragmentation; protected; 2 1.0 yes
198 1737630 7431 918 la hotte bush frog Eleutherodactylus Eleutherodactylidae Terrestrial Haiti; \r\n The habitat of this species is being destroyed at a high rate throughout the Tiburon Pen... ['\n Although it occurs in the Parc National Macaya, there is no active management of this ar... ... Leptodactylidae Eleutherodactylus Female snout-vent length: up to 34 mm (2) Currently almost a quarter of all amphibian species on the British Virgin Islands are categorise... A number of conservation recommendations have been made to protect the native fauna of the Briti... protected; 0 1.0 yes
199 1308540 7855 691 penitent mussel, southern combshell Epioblasma Unionidae NaN United States (Alabama, Georgia, Mississippi); NaN NaN ... Unionidae Epioblasma Length: up to 7 cm (2) (3) Human modifications to streams and rivers have had a serious impact on this once common and wide... In 1997 the oyster mussel was listed as Endangered by the U.S. Fish and Wildlife Service (7) and... pollution; 1 0.0 yes

200 rows × 31 columns


In [8]:
#label first 200 tuples
#g0 = em.label_table(G, 'name', verbose=False)
#G1_labeled = em.label_table(G, 'gold', verbose=False)


Column name (gold) is not present in dataframe
For some attr. values in (rtable_id) in the foreign table there are no values in (id) in the base table
Candset does not satisfy foreign key constraint with the right table
---------------------------------------------------------------------------
AssertionError                            Traceback (most recent call last)
<ipython-input-8-afdb3104d265> in <module>()
      1 #label first 200 tuples
      2 #g0 = em.label_table(G, 'name', verbose=False)
----> 3 G1_labeled = em.label_table(G, 'gold', verbose=False)

/Users/andrew/anaconda/lib/python3.5/site-packages/py_entitymatching-0.1.0-py3.5.egg/py_entitymatching/labeler/labeler.py in label_table(table, label_column_name, verbose)
     51     # Validate the input parameters: check input types, check the metadata
     52     # for the input DataFrame as it will get copied to the labeled DataFrame
---> 53     _validate_inputs(table, label_column_name, verbose)
     54 
     55     # Initialize the table to be labeled: create a copy and set the column

/Users/andrew/anaconda/lib/python3.5/site-packages/py_entitymatching-0.1.0-py3.5.egg/py_entitymatching/labeler/labeler.py in _validate_inputs(table, label_column_name, verbose)
    114     cm._validate_metadata_for_candset(table, key, fk_ltable, fk_rtable,
    115                                       ltable, rtable, l_key, r_key,
--> 116                                       logger, verbose)
    117 
    118     # Return True if everything was successful

/Users/andrew/anaconda/lib/python3.5/site-packages/py_entitymatching-0.1.0-py3.5.egg/py_entitymatching/catalog/catalog_manager.py in _validate_metadata_for_candset(candset, key, foreign_key_ltable, foreign_key_rtable, ltable, rtable, ltable_key, rtable_key, lgr, verbose)
   1142                      'the right table')
   1143         raise AssertionError(
-> 1144             'Candset does not satisfy foreign key constraint with '
   1145             'the right table')
   1146 

AssertionError: Candset does not satisfy foreign key constraint with the right table

In [ ]: