Introduction to Hyphe: A New Webcrawler for Analyzing Controversies
Workshops directed by Mathieu Jacomy, MédiaLab, Sciences Po, Paris
Monday, January 26, 20153:00 PM - 5:00 PM
Laboratory for Digital Cultural Heritage, first floor, YRL
The International Institute and the UCLA Program on International Migration in collaboration with Telecom ParisTech and the Programme Migrations & Numeriques, Maison des Sciences de l’Homme, Paris
are proud to present:
Traces and Traceability:
Tracking migration and analyzing controversies using Hyphe
Workshops directed by Dana Diminescu, Paris-Télécom/Tech and Mathieu Jacomy, MédiaLab, Sciences Po, Paris
Monday, January 26 3-5 and Wednesday, January 28, 3-5
Laboratory for Digital Cultural Heritage, first floor, YRL
In the contemporary era, the migration of population across boundaries leaves multiple digital traces whether involving phone calls, email exchanges, video-communications technologies and recordings, web browing, posting on forums, and actively networking on social networks sites.
This workshop will develop the concept of migrant traceability and then use the example of migrant traces to introduce non-technical users to a new web crawler, Hyphe, designed so that researchers can control the building of a web corpus (by filtering and qualifying the websites to include in the corpus) while simultaneously providing powerful tools capable of handling the huge amount of data available on the web.
Using modern and robust technologies such as Lucene, MongoDB, Scrapy, Twisted, Thrift, Domino.js, Sigma.js or Bootstrap, Hyphe can manage multiple corpora within each instance, bypassing crawling issues (redirections, cookies, javascript-only pages, …), handling multi-websites entities from the web interface, tagging the results, and so on…Hyphe is easy to use. Workshop participants will simply need a laptop equipped with a conventional web browser (Chrome, Firefox, etc) and access to the internet. Depending on time and interest, the Wednesday workshop will also provide an overview of Gephi.
Dana Diminescu is Senior Lecturer in Sociology at Télécom ParisTech engineering school and scientific director of ICT-Migration program of the Fondation Maison des Sciences de l'Homme. She designed and coordinated the e-Diasporas Atlas, of which an important technical component included the free network visualization platform Gephi.
Mathieu Jacomy is a research engineer at médialab in Sciences Po Paris. Web mapping and visual networks analysis are his main fields of expertise. Working in the ICT-Migration program, he developed the technical parts of the e-Diasporas Atlas project. Now in Sciences Po, he is in charge of the Dime Web instrument, supporting researchers in using digital methods
Thanks to support from: Télécom ParisTech and the Programme Migrations & Numeriques, Maison des Sciences de l’Homme, Paris ; the International Institute; UCLA Interdisciplinary and Cross-campus Affairs; the UCLA School of Law; The UCLA Graduate School of Education and Information Studies; the Irene Flecknoe Ross Lecture Series in the Department of Sociology. The Irene Flecknoe Ross Lecture Series is made possible by a gift from Ray Ross in memory of his wife.
