Learned societies are one of the main aspects of scientific academic community. Throughout history researchers and proffesors have been linked to each other by organizations that focus from principal ideas to methods. In this notebook we are going to do some stuff.
Some thins we are interested:
In [1]:
import pandas as pd
columns = ['name', 'abr', 'web', 'aboutus', 'aboutus_link', 'governance_link', 'notes']
df = pd.DataFrame(columns=columns)
df
Out[1]:
To our knowledge currently there are at least three organizations that associated different learned societies. These are:
There are other sources also: http://en.wikipedia.org/wiki/List_of_learned_societies
Let's start with getting some information from American Council of Learned Societies
In [2]:
from disciplines.data import learned_societies
learned_societies_urls = learned_societies.learned_societies_urls
learned_societies_urls
Out[2]:
In [3]:
acls_member_count = len(learned_societies.acls_members)
acls_member_count
Out[3]:
In [4]:
ise_members, ise_observers = learned_societies.initiative_for_science_in_europe()
len(ise_members), len(ise_observers)
Out[4]:
The entries are separated into different pages.
In [5]:
import string
alphabet = string.ascii_uppercase
url_list = ['https://www.britac.ac.uk/links/uksahss.asp?Letter={}'.format(x) for x in alphabet]
url_list[0]
Out[5]:
We are going to requests or urlib to gather the entries. They are going to be saved
One of approaches is to do it all in pandas dataframe.
Some information can be retrieved from dbpedia.
In [6]:
from rdflib import Graph, URIRef
from disciplines.data import dbpedia
url = 'http://dbpedia.org/page/Category:Learned_societies'
g = Graph()
g.parse(url)
mylist = []
In this part we are going to analyze different societies one by one. It is important to do so because it will enable us to structure our data more precisely.
In [7]:
import requests
from bs4 import BeautifulSoup
url = r'http://www.4sonline.org/officers'
url = r'http://www.4sonline.org/society'
urls = r'http://www.4sonline.org/profession/category/professional_associations'
r = requests.get(url)
soup = BeautifulSoup(r.text)
In [8]:
import networkx as nx
g = nx.Graph()
In [9]:
name = 'Society for Social Studies of Science'
description = '''Society for Social Studies of Science is the oldest and largest scholarly association devoted to understanding science and technology. While as many of us study technology as science, we continue to use our original name, or simply "4S".
Mission
The Society for Social Studies of Science exists to facilitate communication across conventional boundaries that separate the disciplines and across national boundaries that separate scholars.
4S includes
scholars in sociology, anthropology, history, philosophy, political science, economics, and psychology
areas of study that fall outside of the traditional academic disciplines such as feminist studies and cultural studies, as well as those addressing science and technology for the public
studies of knowledge, policy, R&D, the development and use of specific technologies
working scientists and engineers interested in the social aspects of their fields
members of the public who have an interest in the way that science and technology affect their lives'''
governance = {'Gary Downey':'President' ,
'Steve Zehr':'Secretary',
'Paige Miller':'Treasurer',
'Wesley Shrum':'Program Officer'}
# list of voculbaries, in which fir
council = [
{'council member':'Kenji Ito', 'expires':'2014'} ,
{'council member':'Leandro Rodriguez Medina', 'expires':'2014'},
{'council member':'Kaushik Sunder Rajan', 'expires':'2014'},
{'council member':'Wen Hua Kuo', 'expires':'2015'} ,
{'council member':'Vivian Lagesen', 'expires':'2015'},
{'council member':'Kelly Moore', 'expires':'2015'},
{'council member':'Abby Kinchy', 'expires':'2014'},
{'council member':'Claire Waterton', 'expires':'2014'},
{'council member':'Sulfikar Amir', 'expires':'2014'}]
links = []
In [10]:
g.add_node(name, {'type':'learned_society'})
g.add_node(description, {'type':'description'})
g.add_edge(name, description, {'type':'description','source':'http://www.4sonline.org/society'})
for x in governance:
g.add_node(x, {'type':'person'})
g.add_edge(name, x, {'type': governance[x]})
In [11]:
for x in council:
g.add_node(x['council member'], {'type':'person'})
g.add_edge(name, x['council member'], {'type':'council member', 'expires':x['expires']})
In [12]:
get_council_members = [x for x, y, z in g.edges_iter(data=True) if z['type'] == 'council member']
get_presidents = [(x,y) for x, y, z in g.edges_iter(data=True) if z['type'] == 'President']
get_persons = [x for x, y in g.nodes_iter(data=True) if y['type'] == 'person']
In [13]:
get_presidents
Out[13]:
In [14]:
name = 'Scientometric Society for Scientometrics and Informetrics'
website = 'http://issi-society.org/'
mission = '''The Society aims to encourage communication and exchange of professional information in the field of scientometrics and informetrics, to improve standards, theory and practice in all areas of the discipline, to stimulate research, education and training, and to enhance the public perception of the discipline.
The Articles of Association state that the aim of ISSI is:
The advancement of the theory, methods and explanations through two main streams.
Quantitative Studies
Scientific, technological and other scholarly substantive information
Science of science and technology, social sciences, arts and humanities
Generation, diffusion and use of information
Information systems, including libraries, archives and databases
Mathematical, Statistical, and Computational Modeling and Analysis of Information Processes.'''
history = '''The Society was founded at the International Conference on Bibliometrics, Informetrics and Scientometrics held in Berlin, 11-15 September in 1993. This conference was the fourth of a series of prominent biennial conferences that subsequently have been held under the auspices of the Society. The Society was incorporated with formal Articles of Association in 1994 in the Netherlands (Utrecht); Dr Hildrun Kretschmer was elected its first President.
The International Society for Informetrics and Scientometrics, ISSI, is an association of professionals active in the emerging interdisciplinary fields of informetrics, bibliometrics/scientometrics, technometrics and webometrics. Among its membership are scientists from over 30 countries representing all five continents.
office bearers in issi
The first President of ISSI was Hildrun Kretschmer (Germany) voted in by members of the Conference audience in Berlin, 1993. In 1995, following the ISSI conference in Chicago, Michael E.D. Koenig (USA) took over the Presidency for a period of two years. The following two years saw Bluma Peritz (Israel) as ISSI President; César Macías-Chapula (Mexico) for the years 1999-2001 and Mari Davis (Australia) 2001-2003. In 2002, the ISSI Board reviewed its policies relating to election of ISSI Board positions. In 2003, the first open voting for the President and the Board was conducted electronically among all members of the Society. Henry Small (USA) was elected the 6th president. In 2007 Ronald Rousseau (BEL) has been elected the 7th president of the society.'''
president = 'Ronald Rousseau '
secretary = u'Wolfgang Glänzel'
treasurer = u'Wolfgang Glänzel'
members = [
'Kevin Boyack',
u'Vincent Larivière',
'Jacqueline Leta',
'Henk Moed',
'Ed Noyons',
'Cassidy Sugimoto'
]
members1 = [
'Aparna Basu',
'Leo Egghe',
'Peter Ingwersen',
'Grant Lewison',
'Henk Moed',
'Ed Noyons'
]
members2 = [
'Judit Bar-Ilan',
'Aparna Basu',
'Peter Ingwersen',
'Grant Lewison',
'Martin Meyer',
'Olle Persson'
]
g.add_node(name,{'type':'learned society'})
g.add_node(website,{'type':'learned society'})
g.add_edge(name, website)
g.add_node(mission)
g.add_edge(website, mission, {'type':'mission'})
g.add_node(history)
g.add_edge(website, history, {'type':'history'})
g.add_node(president)
g.add_edge(website, president, {'type':'president'})
g.add_node(secretary)
g.add_edge(website, secretary, {'type':'secretary'})
g.add_node(treasurer)
g.add_edge(website, treasurer, {'type':'treasurer'})
for x in members:
g.add_node(x)
g.add_edge(website, x, {'type':'board member', '2012':True, '2013':True, '2015':True})
for x in members1:
g.add_node(x)
g.add_edge(website, x, {'type':'board member', '2011':True, '2012':True, '2013':True})
for x in members2:
g.add_node(x)
g.add_edge(website, x, {'type':'board member', '2009':True, '2010':True, '2011':True})
In [15]:
import matplotlib.pyplot as plt
%matplotlib inline
pos = nx.fruchterman_reingold_layout(g)
nx.draw_networkx_nodes(g,pos)
nx.draw_networkx_edges(g,pos)
nx.draw_networkx_labels(g,pos)
Out[15]:
Adding a journal
Move to journals
In [16]:
Editor_in_Chief = 'T. Braun (Hungary)'
Editor = 'A. Schubert (Hungary)'
Co_editor = 'W. Glänzel (Belgium/Hungary)'
Honorary_Editors = [
'M.T. Beck (Hungary)',
'E. Garfield (USA)',
'M. Orbán (Hungary)']
Associate_Editors = [
'A. Balaban (Romania)',
'A. Bookstein (USA)',
'M. Bonitz (Germany)',
'J. P. Courtial (France)',
'H.-D. Daniel (Switzerland)',
'I. Gomez (Spain)',
'D.H. Kraft (USA)',
'H. Kretschmer (Germany)',
'L. Liang (China)',
'C. McCain (USA)',
'A.J. Meadows (UK)',
'H. Moed (The Netherlands)',
'F. Da Pozzo (Switzerland)',
'E. Rinia (The Netherlands)',
'V. Trimble (USA)',
'P.Vinkler (Hungary)']
Editorial_Board = [
'H.A. Abt (USA)',
'J. Bar-Ilan (Israel)',
'E. Bassecoulard (France)',
'M. Bordons (Spain)',
'Q. Burrell (Isle of Man)',
'L. Butler (Australia)',
'S. Cole (USA)',
'B. Cronin (USA)',
'M. Davis (Australia)',
'K. Debackere (Belgium)',
'L. Egghe (Belgium)',
'H. Eto (Japan)',
'L. Georghiou (UK)',
'B. Godin (Canada)',
'H. Grupp (Germany)',
'P. Ingwersen (Denmark)',
'R.N. Kostoff (USA)',
'M.E.D. Koenig (USA)',
'M. Krauskopf (Chile)',
'G. Lewison (UK)',
'L. Leydesdorff (The Netherlands)',
'M. Meyer (UK)',
'F. Narin (USA)',
'A. Nederhof (The Netherlands)',
'E. Noyons (The Netherlands)',
'Y. Okubo (France)',
'O. Persson (Sweden)',
'B. Peritz (Israel)',
'I.K. Ravichandra Rao (India)',
'R. Rousseau (Belgium)',
'J. Russell (Mexico)',
'H. Small (USA)',
'W.E. Snizek (USA)',
'A. Van Raan (The Netherlands)',
'H.D. White (USA)',
'C.S. Wilson (Australia)',
'M. Zitt (France)']
Editor_in_Chief, Editor, Co_editor, Honorary_Editors, Associate_Editors, Editorial_Board
Out[16]:
Move to journals
In [20]:
#another journal, related
url = 'http://www.issi-society.org/joi/'
Name = 'JOURNAL OF INFORMETRICS'
ISSN = '0138-9130'
Publisher = 'Elsevier B.V.'
Editor_in_chief = 'Leo Egghe (Hasselt University, Belgium)'
Editorial_Board = [
'P. Ahlgren (The Swedish School of Library and Information Science, Sweden)',
'J. Bar-Ilan (Bar-Ilan University, Israel)',
'J. Bollen (Los Alamos National Laboratory, USA)',
'A. Bookstein (University of Chicago, USA)',
'K. Börner (Indiana University, USA)',
'K. Boyack (Sandia National Laboratories, USA)',
'Q. Burrell (Isle of Man International Business School, Isle of Man)',
'C. Chen (Drexel University, Philadelphia)',
'B. Cronin (Indiana University, USA)',
'W. Glänzel (K.U. Leuven, Belgium)',
'P. Ingwersen (Royal School of LIS, Denmark)',
'R.N. Kostoff (Office of Naval Research, USA)'
'D. Kraft (Louisiana State University, USA)',
'H. Kretschmer (Humboldt-University Berlin, Germany)',
'T. Lafouge (University Claude Bernard Lyon 1, France)',
'L. Leydesdorff (University of Amsterdam, The Netherlands)',
'L. Liang (Henan Normal University, China)',
'K. McCain (Drexel University, Philadelphia, USA)',
'H. Moed (Leiden University, The Netherlands)',
'D. Ocholla (University of Zululand, South Africa)',
'O. Persson (Umeå University, Sweden)',
'I.K. Ravichandra Rao (Indian Statistical Institute, India)',
'S. Redner (Boston University, USA)',
'R. Rousseau (KHBO, Belgium)',
'I. Rowlands (University College London, UK)',
'S. Shi (University of Shanghai, Shanghai)',
'H. Small (ISI Thomson Scientific, USA)',
'M. Thelwall (University of Wolverhampton, UK)',
'A. van Raan (Leiden University, The Netherlands)',
'L. Vaughan (The University of Western Ontario, Canada)',
'C. Wilson (The University of New South Wales, Australia)',
'D. Wolfram (University of Wisconsin, USA)']
Here we will see how to automatize the data.
In [21]:
#soup.find_all(True,recursive=True)
In [22]:
li = soup.find(True, {'id':'container'})
children = li.findChildren()
for child in children:
print child
In [23]:
soup.find_all('strong')
Out[23]:
In [24]:
'http://www.issi-society.org/board.html'
Out[24]:
In [25]:
'http://www.issi-society.org/links.html' #Three types: institutes, societies and journals
Out[25]:
Move to journals
In [26]:
'http://www.issi-society.org/scientometrics/' #lots of abstracts, editors and review.
'http://www.historyoftechnology.org/Resources/' #lots of diferent links
'http://www.historyoftechnology.org/Resources/classic_works.html'
Out[26]:
In [27]:
url = 'https://www.econometricsociety.org/society/organization-and-governance/executive-committee/past-officers-council'
r = requests.get(url)
soup = BeautifulSoup(r.text)
In [28]:
#print soup.find(True)
In [29]:
'https://www.econometricsociety.org/society/organization-and-governance/council'
Out[29]:
In [30]:
'http://www.4sonline.org/past_officers'
Out[30]:
In [31]:
'http://www.4sonline.org/committees'
Out[31]:
In [32]:
'https://www.econometricsociety.org/society/organization-and-governance/fellows'
Out[32]:
In [33]:
'http://easst.net/resources/#is' #'International Societies'
Out[33]:
In [34]:
links_from_east = [['British Society for the Philosophy of Science'
'The purpose of the British Society for the Philosophy of Science is to study the logic, the methods, and the philosophy of science, as well as those of the various special sciences, including the social sciences.'
'www.thebsps.org'],
['European Philosophy of Science Associationepsa'
'The general aim of the EPSA is to promote and advance philosophy of science in Europe. It was established in 2007 to bring together professional philosophers of science and students from the whole of Europe (and the rest of the world) and foster collaboration and exchange of ideas among them.'
'www.epsa.ac.at'],
['History of Philosophy of Sciencehopos'
'HOPOS, The International Society for the History of Philosophy of Science, is devoted to promoting serious, scholarly research on the history of the philosophy of science. It aims to promote historical work in a variety of ways, but especially through encouraging exchange among scholars through meetings, publications, and electronic media.'
'www.hopos.org'],
['History of Science Societyhss'
'The History of Science Society is dedicated to understanding science, technology, medicine, and their interactions with society in historical context. Over 3,000 individual and institutional members across the world support the Society’s mission to foster interest in the history of science and its social and cultural relations.'
'www.hssonline.org'],
['International Committee for the History of Technologyicohtec'
'ICOHTEC was founded in 1968 to provide a forum of scholars for the history of technology from both sides of the ‚iron curtain‘. It was constituted as a Scientific Section within the Division of the History of Science and Technology of the International Union of the History and Philosophy of Science (IUHPS/DHST).'
'www.icohtec.org'],
['Société d’Anthropologie des Connaissances'
'The Société d’Anthropologie des Connaissances was founded in 2006 to stimulate multidisciplinary investigations on practices and forms of knowledge, professions, organizations and institutions, techniques and circulation and to promote the development of joint research in a wide variety of social and human sciences.'
'www.ird.fr/socanco'],
['Society for the History of Technology (SHOT)Society for the history of techonology'
'SHOT was formed in 1958 to encourage the study of the development of technology and its relations with society and culture. It is concerned not only with the history of technological devices and processes but also with technology in history.'
'www.historyoftechnology.org'],
['Society for Philosophy and Technology'
'The Society for Philosophy and Technology is an independent international organization that encourages, supports and facilitates philosophically significant considerations of technology. Founded in 1976, SPT maintains an association with the American Philosophical Association.'
'www.spt.org']]
In [35]:
links_from_east
Out[35]:
In [36]:
'http://www.thebsps.org/society/bsps/related.html' # Not structured one
Out[36]:
CURRENT OFFICERS (2013-2015) CURRENT OFFICERS (2011-2013) name(link to perswebpage), institution(position)
In [37]:
'http://www.epsa.ac.at/network/'
'http://www.epsa.ac.at/about/steering-comittee/'
print '''
ABOUT EPSA
The European Philosophy of Science Association (EPSA) was established in 2007. It was brought to life by the recognition that the time was ripe for a forum that would bring together professional philosophers of science and students from the whole of Europe (and the rest of the world) and foster collaboration and exchange of ideas among them.
The general aim of the EPSA is to promote and advance philosophy of science in Europe. Membership to EPSA is open to everyone, irrespective of nationality.'
We invite all philosophers of science to join us in this endeavour and to embrace the EPSA!
'''
In [38]:
'http://www.historyoftechnology.org/index.html'
Out[38]:
In [39]:
'http://www.historyoftechnology.org/about_us/index.html'
Out[39]:
In [40]:
'http://www.historyoftechnology.org/about_us/officers.html'
Out[40]:
In [41]:
'http://www.amphilsoc.org/memhist/search?browse-all=yes;sort=creator'
Out[41]:
In [41]:
In [ ]: