Run this from the _talks/ directory, which contains .md files of all your talks. This scrapes the location YAML field from each .md file, geolocates it with geopy/Nominatim, and uses the getorg library to output data, HTML, and Javascript for a standalone cluster map.
In [16]:
!pip install getorg python-frontmatter
Requirement already satisfied: getorg in /home/staeiou/conda/lib/python3.5/site-packages
Collecting python-frontmatter
Downloading https://files.pythonhosted.org/packages/af/d0/187b76788777105d82aae97fa9c20cca18508c948eb43807855818c6f020/python-frontmatter-0.4.2.tar.gz
Requirement already satisfied: pygithub in /home/staeiou/conda/lib/python3.5/site-packages (from getorg)
Requirement already satisfied: retrying in /home/staeiou/conda/lib/python3.5/site-packages (from getorg)
Requirement already satisfied: geopy in /home/staeiou/conda/lib/python3.5/site-packages (from getorg)
Requirement already satisfied: PyYAML in /home/staeiou/conda/lib/python3.5/site-packages (from python-frontmatter)
Requirement already satisfied: six in /home/staeiou/conda/lib/python3.5/site-packages (from python-frontmatter)
Requirement already satisfied: pyjwt in /home/staeiou/conda/lib/python3.5/site-packages (from pygithub->getorg)
Building wheels for collected packages: python-frontmatter
Running setup.py bdist_wheel for python-frontmatter ... done
Stored in directory: /home/staeiou/.cache/pip/wheels/f3/80/15/1ca9f999164f756f98f72efa11400d84f0dd6192a209267b6c
Successfully built python-frontmatter
Installing collected packages: python-frontmatter
Successfully installed python-frontmatter-0.4.2
You are using pip version 9.0.1, however version 10.0.1 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
In [17]:
import glob
import getorg
from geopy import Nominatim
import frontmatter
In [5]:
g = glob.glob("_talks/*.md")
In [6]:
geocoder = Nominatim()
location_dict = {}
location = ""
permalink = ""
title = ""
In [25]:
a = frontmatter.load(file)
a.to_dict()
Out[25]:
{'collection': 'talks',
'content': "<a href='http://trace-ethnography.github.io'>Link to more information</a>",
'date': datetime.date(2015, 3, 24),
'location': 'Newport Beach, CA',
'permalink': '/talks/2015-03-24-iconf-trace-ethno',
'title': 'Trace Ethnography Workshop',
'type': 'Workshop presentation',
'venue': 'ISchools Conference'}
In [30]:
for file in g:
data = frontmatter.load(file)
data_dict = data.to_dict()
location = data_dict['location']
if location[-4:] == ", CA":
location = location[:-3] + " California"
descript_name = location + " | " + data_dict['venue'] + " | " + data_dict['title']
location_dict[descript_name] = geocoder.geocode(location)
print(descript_name, "\n", location, "\n", location_dict[location], "\n\n")
Newport Beach, California | ISchools Conference | Trace Ethnography Workshop
Newport Beach, California
Newport Beach, Orange County, California, United States of America
Astoria, New York | Theorizing the Web | “What the hack?” Hacking culture and discourse in data science pedagogy (with Brittany Fiore-Gartland)
Astoria, New York
Astoria, Queens County, NYC, New York, 10029, United States of America
Washington, DC | Annual Conference on Science and Technology in Society | Working With/in Wikipedia: Infrastructures of Knowing and Knowledge Production
Washington, DC
Washington, District of Columbia, United States of America
Fukuoka, Japan | Algorithms, Automation, and Politics workshop | Algorithms as agents of gatekeeping, governance, and articulation work in Wikipedia
Fukuoka, Japan
福岡県, 九州地方, 日本
Hong Kong | International Symposium on Wikis and Open Collaboration (WikiSym 2012) | When the Levee Breaks: Without Bots, What Happens to Wikipedia’s Quality Control Processes? (with Aaron Halfaker)
Hong Kong
香港 Hong Kong, 中西區 Central and Western District, 香港島 Hong Kong Island, HK, PACIFIC PLACE, 中国
New York, NY | Theorizing the Web | Values Where? Interrogating Client-Side Scripting as a Design Process
New York, NY
ny, Suffolk County, New York, United States of America
Albany, California | Bay Area Science Festival | The Humanity of Artificial Intelligence
Albany, California
Albany, Alameda County, California, United States of America
Copenhagen, Denmark | IT University of Copenhagen, ETHOSlab | Computational Ethnography and the Ethnography of Computation: The Case for Context
Copenhagen, Denmark
København, Københavns Kommune, Region Hovedstaden, 1357, Danmark
Fukuoka, Japan | Big Data: Critiques and Alternatives workshop | Successor Systems: Lessons for Big Data From Feminist Epistemology and Activism
Fukuoka, Japan
福岡県, 九州地方, 日本
Barcelona, Spain | Annual Meeting of the Society for the Social Study of Science (4S) | “The Wisdom of Bots:” An ethnographic study of the delegation of governance work to information infrastructures in Wikipedia
Barcelona, Spain
Barcelona, BCN, CAT, España
Dublin, Ireland | International Conference on Weblogs and Social Media (ICWSM) | Defense Mechanism or Socialization Tactic? Improving Wikipedia’s Notifications to Rejected Contributors
Dublin, Ireland
Dublin, County Dublin, Leinster, Ireland
Denver, CO | Annual Meeting of the Society for the Social Study of Science (4S) | The Bot Multiple: Unpacking the Materialities of Automated Software Agents
Denver, CO
Denver, Denver County, Colorado, United States of America
San Francisco, California | Wikipedia 15th Anniversary Birthday Bash | Why bots are my favorite contribution to Wikipedia
San Francisco, California
California, San Francisco, El Carmen, Norte de Santander, Colombia
Amsterdam, the Netherlands | Critical Point of View: Wikipedia and the Politics of Open Knowledge | Bot Politics: How is Automation Changing the Wikipedian Society? Critical Point of View II
Amsterdam, the Netherlands
Amsterdam, Centrum, Amsterdam, Noord-Holland, Nederland
New York, NY | the Second Annual Media Sociology Forum | Trace Ethnography: An ANT Method for the Study of Sociotechnical Networks
New York, NY
ny, Suffolk County, New York, United States of America
Manchester, United Kingdom | University of Manchester, Data Science Institute | The Human Contexts of Data: Infrastructures, Institutions, and Interpretations
Manchester, United Kingdom
Manchester, Greater Manchester, North West England, England, UK
College Park, Maryland | College of Information Studies, University of Maryland at College Park | Computational Ethnography and the Ethnography of Computation: The Case for Context
College Park, Maryland
College Park, Prince George's County, Maryland, United States of America
Vancouver, BC | CSCW Workshop on Feminism and Feminist Approaches in Social Computing | Situated knowledges and successor systems: developing CSCW systems to enact ideological critiques
Vancouver, BC
Vancouver, Metro Vancouver, British Columbia, Canada
Seattle, WA | Annual Meeting of the International Communication Association (ICA) | Data-Driven Data Research Using Data and Databases: A Practical Critique of Methods and Approaches in “Big Data” Studies
Seattle, WA
Seattle, King County, Washington, United States of America
Bangalore, India | Critical Point of View: Wikipedia and the Politics of Open Knowledge | The Wisdom of Bots: A Critique of ‘Self-Organization’ in Wikipedia
Bangalore, India
Bengaluru, Bangalore Urban, Karnataka, भारत
Bangkok, Thailand | Bangkok Scientifique | Size Matters: How Big Data Changes Everything
Bangkok, Thailand
กรุงเทพมหานคร, ประเทศไทย
Cambridge, MA | Media in Transition 6 | Evolving Governance and Media Use in Wikipedia: A Historical Account
Cambridge, MA
Cambridge, Middlesex County, Massachusetts, United States of America
Lihue, Hawaii | Hawaii International Conference on System Sciences | Trace Ethnography: Following Coordination through Documentary Practices
Lihue, Hawaii
Lihue, Kauai County, Hawaii, 96766, United States of America
Berkeley, California | The 21st Annual BCLT/BTLJ Symposium | Demystifying Algorithmic Processes: The Case of Wikipedia
Berkeley, California
Berkeley, Alameda County, California, United States of America
Gdansk, Poland | Wikimania 2010 | Academic Researchers in Wikimedia Communities: Ethics, Methods, and Policies
Gdansk, Poland
Gdańsk, pomorskie, RP
Kyoto, Japan | GCOE International Symposium on Informatics Education | Improving Wikipedia’s Notifications to Rejected Contributors
Kyoto, Japan
京都市, 京都府, 近畿地方, 日本
Fukuoka, Japan | Communicating with Machines workshop | Administrative Support Bots in Wikipedia: How Automation Can Transform the Affordances of Platforms and the Governance of Communities
Fukuoka, Japan
福岡県, 九州地方, 日本
Long Beach, California | Digital Media and Learning (DML) | Machine-Generated Content: Bots and the Governance of Wikipedia
Long Beach, California
Long Beach, Los Angeles County, California, United States of America
Tartu, Estonia | 2017 Annual Meeting of the Association of Internet Researchers | "But it wouldn’t be an encyclopedia; it would be a wiki": The changing imagined affordances of wikis, 1995-2002
Tartu, Estonia
Tartu, Tartu linn, Tartu maakond, Eesti
Berkeley, California | History of Information | Governing the Commons
Berkeley, California
Berkeley, Alameda County, California, United States of America
Berkeley, California | Social Aspects of Information Systems course | Moderating Online Conversation Spaces
Berkeley, California
Berkeley, Alameda County, California, United States of America
Davis, California | The Contours of Algorithmic Life | Successor Systems: The Role of Reflexive Algorithms in Enacting Ideological Critique
Davis, California
Davis, Yolo County, California, United States of America
Denver, CO | Annual Meeting of the Association of Internet Researchers (AoIR) | Design by Bot: Power and Resistance in the Development of Automated Software Agents
Denver, CO
Denver, Denver County, Colorado, United States of America
Linz, Austria | International Symposium on Wikis and Open Collaboration (WikiSym 2012) | What Aren’t We Measuring? Methods for Quantifying Wiki-Work.
Linz, Austria
Linz, Oberösterreich, 4010, Österreich
Brooklyn, New York | Theorizing the Web | Successor Systems: Enacting Ideological Critique Through the Development of Software
Brooklyn, New York
Brooklyn, Cattaraugus County, New York, 14729, United States of America
Berkeley, California | Robots and New Media | Robotic Ethics and Opportunities
Berkeley, California
Berkeley, Alameda County, California, United States of America
Pittsburgh, PA | Human Computation Conference (HCOMP), Citizen-X Workshop | Defining, Designing, and Evaluating Civic Values in Human Computation and Collective Action Systems (with Nathan Matias)
Pittsburgh, PA
PGH, Allegheny County, Pennsylvania, United States of America
Berkeley, California | Crowdsourcing and the Academy Symposium | Crowdsourcing: Theoretical Considerations
Berkeley, California
Berkeley, Alameda County, California, United States of America
College Station, TX | Exploring New Media Worlds | A Communicative Ethnography of Argumentative Strategies in a Wikipedian Content Dispute
College Station, TX
College Station, Brazos County, Texas, United States of America
San Juan, Puerto Rico | Annual Meeting of the International Communication Association (ICA) | But it Wouldn’t Be an Encyclopedia; It Would Be a Wiki: Wikipedia and the Repurposing of WikiWikiWeb
San Juan, Puerto Rico
San Juan, Puerto Rico, United States of America
San Antonio, TX | Conference on Computer Supported Cooperative Work | Using Edit Sessions to Measure Participation in Wikipedia (with Aaron Halfaker)
San Antonio, TX
San Antonio, Bexar County, Texas, United States of America
San Diego, California | Annual Meeting of the Society for the Social Study of Science (4S) | Hadoop as Grounded Theory: Is an STS Approach to Big Data Possible? the 2013 Annual Meeting of the Society for the Social Study of Science 4S
San Diego, California
San Diego, San Diego County, California, United States of America
Buenos Aires, Argentina | Annual Meeting of the Society for the Social Study of Science (4S) | Successor Systems: The Role of Reflexive Algorithms in Enacting Ideological Critique
Buenos Aires, Argentina
Buenos Aires, Esquel, Departamento Futaleufú, CHB, Argentina
Chapel Hill, North Carolina | School of Information and Library Science, University of North Carolina at Chapel Hill | Computational Ethnography and the Ethnography of Computation: The Case for Context
Chapel Hill, North Carolina
Chapel Hill, Orange County, North Carolina, United States of America
Arlington, Virginia | Annual Meeting of the Society for the Social Study of Science (4S) | Where Are the Missing Wikipedians? The Sociology of a Bot
Arlington, Virginia
Arlington, Arlington County, Virginia, United States of America
Vancouver, BC | CSCW Workshop on Ethics for Studying Sociotechnical Systems in a Big Data World | Does Facebook Have Civil Servants? On Governmentality and Computational Social Science
Vancouver, BC
Vancouver, Metro Vancouver, British Columbia, Canada
Austin, Texas | Conference on Human Factors in Computing (CHI) | Black-boxing the user: internet protocol over xylophone players (IPoXP)
Austin, Texas
Austin, Travis County, Texas, United States of America
San Antonio, TX | ACM Conference on Computer-Supported Cooperative Work (CSCW) | Community, Impact, and Credit: Where Do I Submit My Papers?
San Antonio, TX
San Antonio, Bexar County, Texas, United States of America
Phoenix, AZ | Annual Meeting of the Association of Internet Researchers (AoIR) | Bot-Based Collective Blocklists in Twitter: The Counterpublic Moderation of a Privately-Owned Networked Public Space
Phoenix, AZ
Phoenix, Maricopa County, Arizona, United States of America
Cambridge, MA | Berkman Center for Internet and Society | Supporting Change from Outside Systems with Design and Data
Cambridge, MA
Cambridge, Middlesex County, Massachusetts, United States of America
Berkeley, California | Berkeley Institute for Data Science | Computational Ethnography and the Ethnography of Computation
Berkeley, California
Berkeley, Alameda County, California, United States of America
Berkeley, California | UC-Berkeley: Human Contexts and Ethics of Data course | Publics: Witnessing and Measuring
Berkeley, California
Berkeley, Alameda County, California, United States of America
Evanston, IL | Infosocial | Trace literacy: a framework for holistically conceptualizing newcomer socialization in socio-technical systems
Evanston, IL
Evanston, Cook County, Illinois, United States of America
San Francisco, California | PyData SF | Community Sustainability in Wikipedia: A Review of Research and Initiatives
San Francisco, California
California, San Francisco, El Carmen, Norte de Santander, Colombia
Seattle, WA | Annual Meeting of the International Communication Association (ICA) | Big Data is Bullshit': Scoping the Next 5 Years of Digital Data Research
Seattle, WA
Seattle, King County, Washington, United States of America
Astoria, New York | Theorizing the Web | Moderating harassment in Twitter with blockbots: a counterpublic and algorithmic strategy
Astoria, New York
Astoria, Queens County, NYC, New York, 10029, United States of America
Berkeley, California | Social Aspects of Information Systems course | Actor-Network Theory
Berkeley, California
Berkeley, Alameda County, California, United States of America
Mānoa, Hawaiʻi | Open Science Symposium, Department of Second Language Studies, University of Hawaiʻi at Mānoa | Key Values: What We Talk About When We Talk About 'Open Science'
Mānoa, Hawaiʻi
Manoa, Honolulu, Honolulu County, Hawaii, 96822, United States of America
Boston, Massachusetts | 2017 Annual Meeting of the Society for the Social Studies of Science (4S) | Autoethnographic Methods for Studying Data-Driven Knowledge Production
Boston, Massachusetts
Boston, Suffolk County, Massachusetts, United States of America
Daegu, South Korea | Annual Meeting of the Association of Internet Researchers (AoIR) | Successor Systems: The Role of Reflexive Algorithms in Enacting Ideological Critique
Daegu, South Korea
대구, 대한민국
San Diego, California | University of California at San Diego, The Design Lab | The Human Contexts of Computationa and Data: Infrastructures, Institutions, and Interpretations
San Diego, California
San Diego, San Diego County, California, United States of America
Mountain View, California | International Symposium on Wikis and Open Collaboration | Participation in Wikipedia’s Article Deletion Processes (with Heather Ford)
Mountain View, California
Mountain View, Santa Clara County, California, United States of America
Austin, Texas | Conference on Human Factors in Computing (CHI) | Hunting for Fail Whales: Lessons from Deviance and Failure in Social Computing
Austin, Texas
Austin, Travis County, Texas, United States of America
Berkeley, California | Social Aspects of Information Systems course | Peer Production and Wikipedia
Berkeley, California
Berkeley, Alameda County, California, United States of America
Berkeley, California | UC-Berkeley Department of Statistics: Reproducible and Collaborative Data Science | Are the bots really fighting? Behind the scenes of a reproducible replication
Berkeley, California
Berkeley, Alameda County, California, United States of America
Nancy, France | 2018 European Conference on Computer-Supported Cooperative Work | The Types, Roles, and Practices of Documentation in Data Analytics Open Source Software Libraries: A Collaborative Ethnography of Documentation Work
Nancy, France
Nancy, Meurthe-et-Moselle, Grand Est, France métropolitaine, 54000, France
Cleveland, OH | Annual Meeting of the Society for the Social Study of Science (4S) | User-Generated Platforms in Wikipedian Governance
Cleveland, OH
Cleveland, Cuyahoga County, Ohio, United States of America
Fukuoka, Japan | Annual Meeting of the International Communication Association (ICA) | Drowning in Data: Industry and Academic Approaches to Mixed Methods in “Holistic” Big Data Studies
Fukuoka, Japan
福岡県, 九州地方, 日本
Alexandria, Egypt | Annual Wikimedia Conference (Wikimania) | Conceptions and Misconceptions Academics Hold About Wikipedia
Alexandria, Egypt
الإسكندرية, 21519, مصر
Orlando, Florida | International Symposium on Wikis and Open Collaboration | The Social Roles of Bots and Assisted Editing Tools
Orlando, Florida
Orlando, Orange County, Florida, United States of America
Cleveland, OH | Annual Meeting of the Society for the Social Study of Science (4S) | ’The Internet is Here’: The Virtuality of ‘On-line Communities in Physical Spaces
Cleveland, OH
Cleveland, Cuyahoga County, Ohio, United States of America
Mānoa, Hawaiʻi | Open Science Symposium, Department of Second Language Studies, University of Hawaiʻi at Mānoa | Are the bots really fighting? Behind the scenes of an open and reproducible replication study
Mānoa, Hawaiʻi
Manoa, Honolulu, Honolulu County, Hawaii, 96822, United States of America
Austin, Texas | SciPy | Governing Open Source Projects at Scale: Lessons from Wikipedia's Growing Pains
Austin, Texas
Austin, Travis County, Texas, United States of America
Berkeley, California | The Hacker Within, BIDS | Scraping Wikipedia Data
Berkeley, California
Berkeley, Alameda County, California, United States of America
Urbana, Illinois | School of Information Sciences, University of Illinois at Urbana-Champaign | Computational Ethnography and the Ethnography of Computation: The Case for Context
Urbana, Illinois
Urbana, Champaign County, Illinois, United States of America
Savannah, Georgia | Conference on Computer Supported Cooperative Work | The Work of Sustaining Order in Wikipedia: The Banning of a Vandal
Savannah, Georgia
Savannah, Chatham County, Georgia, United States of America
Copenhagen, Denmark | Annual Meeting of the Society for the Social Study of Science (4S) | Time to Degree: Examining the Experiences of Graduate Students in the Long-Term Ecological Research Network
Copenhagen, Denmark
København, Københavns Kommune, Region Hovedstaden, 1357, Danmark
New York, NY | First Annual Wikiconference NYC | Algorithmic Governance: The Social Roles of Bots and Assisted Editing Tools
New York, NY
ny, Suffolk County, New York, United States of America
Prague, Czech Republic | 2018 Annual Conference of the International Communication Association | Knowing User Populations at Scale: From the Science of the State to Platform Governmentality
Prague, Czech Republic
Praha, okres Hlavní město Praha, Hlavní město Praha, Praha, Česko
New York, New York | JupyterCon | Jupyter and the Changing Rituals around Computation
New York, New York
NYC, New York, United States of America
In [31]:
m = getorg.orgmap.create_map_obj()
getorg.orgmap.output_html_cluster_map(location_dict, folder_name="talk_map", hashed_usernames=False)
Out[31]:
'Written map to talk_map/'
In [ ]:
Content source: hiraksarkar/hiraksarkar.github.io
Similar notebooks: