Using dbpedia to get languages influences

While browsing the Python's wikipedia page, I found information about the languages influenced by python, and the languages that influenced python itself.

Well, that's kind of interesting to know which languages influenced others, it could even be more interesting to have an overview of the connexion between them, keeping python as the main focus.

This information is available on the wikipedia page, but not in a really exploitable format. Hopefully, this information is provided into the information box present on the majority of wikipedia pages. And… guess what? there is project with the goal to scrap and index all this information in a more queriable way, using the semantic web technologies.

Well, you may have guessed it, the project in question in dbpedia, and exposes information in the form of RDF triples, which are way more easy to work with than simple HTML.

The interesting properties here are "Influenced" and "InfluencedBy", which allows us to get a list of languages. Unfortunately, they are not really using all the power of the Semantic Web here, and the list is actually a string with coma separated values in it.

Anyway, we can use a simple rule: All wikipedia pages of programming languages are either named after the name of the language itself, or suffixed with "( programming language)", which is the case for python.

After a nice:

$ python get_influences.py python dot | dot -Tpng > influences.png

The result is the following graph (see it directly here)

While reading this diagram, keep in mind that it is a) not listing all the languages and b) keeping a python perspective.

This means that you can trust the scheme by following the arrows from python to something and from something to python, it is not trying to get the matching between all the languages at the same time to keep stuff readable.

It would certainly be possible to have all the connections between all languages (and the resulting script would be easier) to do so, but the resulting graph would probably be way less readable.

You can find the script on my github account. Feel free to adapt it for whatever you want if you feel hackish.

Pelican, 9 months later

Back in October, I released pelican, a little piece of code I wrote to power this weblog. I had simple needs: I wanted to be able to use my text editor of choice (vim), a vcs (mercurial) and restructured text. I started to write a really simple blog engine in ...

There are comments.

Using JPype to bridge python and Java

Java provides some interesting libraries that have no exact equivalent in python. In my case, the awesome boilerpipe library allows me to remove uninteresting parts of HTML pages, like menus, footers and other "boilerplate" contents.

Boilerpipe is written in Java. Two solutions then: using java from python or reimplement boilerpipe ...

There are comments.

Alexis' log

Other articles

Pelican, 9 months later

Using JPype to bridge python and Java

Other articles

blogroll

social