mirror of
https://github.com/almet/notmyidea.git
synced 2025-04-29 03:52:38 +02:00
298 lines
No EOL
14 KiB
HTML
298 lines
No EOL
14 KiB
HTML
<!DOCTYPE html>
|
|
<html lang="en">
|
|
<head>
|
|
<title>An amazing summer of code working on distutils2</title>
|
|
<meta charset="utf-8" />
|
|
<link rel="stylesheet" href="./theme/css/main.css" type="text/css" />
|
|
<link href="./feeds/all.atom.xml" type="application/atom+xml" rel="alternate" title="Alexis' log ATOM Feed" />
|
|
|
|
|
|
<!--[if IE]>
|
|
<script src="http://html5shiv.googlecode.com/svn/trunk/html5.js"></script><![endif]-->
|
|
|
|
<!--[if lte IE 7]>
|
|
<link rel="stylesheet" type="text/css" media="all" href="./css/ie.css"/>
|
|
<script src="./js/IE8.js" type="text/javascript"></script><![endif]-->
|
|
|
|
<!--[if lt IE 7]>
|
|
<link rel="stylesheet" type="text/css" media="all" href="./css/ie6.css"/><![endif]-->
|
|
|
|
</head>
|
|
|
|
<body id="index" class="home">
|
|
|
|
<a href="http://github.com/ametaireau/">
|
|
|
|
<img style="position: absolute; top: 0; right: 0; border: 0;" src="http://s3.amazonaws.com/github/ribbons/forkme_right_red_aa0000.png" alt="Fork me on GitHub" />
|
|
|
|
</a>
|
|
|
|
<header id="banner" class="body">
|
|
<h1><a href=".">Alexis' log </a></h1>
|
|
<nav><ul>
|
|
|
|
|
|
|
|
<li><a href="./pages/projects.html">projects</a></li>
|
|
|
|
|
|
|
|
<li ><a href="./category/asso.html">asso</a></li>
|
|
|
|
<li class="active"><a href="./category/dev.html">dev</a></li>
|
|
|
|
<li ><a href="./category/python.html">python</a></li>
|
|
|
|
<li ><a href="./category/system.html">system</a></li>
|
|
|
|
<li ><a href="./category/thoughts.html">thoughts</a></li>
|
|
|
|
</ul></nav>
|
|
</header><!-- /#banner -->
|
|
|
|
<section id="content" class="body">
|
|
<article>
|
|
<header> <h1 class="entry-title"><a href=""
|
|
rel="bookmark" title="Permalink to An amazing summer of code working on distutils2">An amazing summer of code working on distutils2</a></h1> </header>
|
|
<div class="entry-content">
|
|
<footer class="post-info">
|
|
<abbr class="published" title="2010-08-16T00:00:00">
|
|
Mon 16 August 2010
|
|
</abbr>
|
|
|
|
|
|
<address class="vcard author">
|
|
By <a class="url fn" href="./author/Alexis Métaireau.html">Alexis Métaireau</a>
|
|
</address>
|
|
|
|
<p>In <a href="./category/dev.html">dev</a>. </p>
|
|
|
|
|
|
|
|
</footer><!-- /.post-info -->
|
|
<p>The <a class="reference external" href="http://code.google.com/soc/">Google Summer of Code</a> I've
|
|
spent working on <a class="reference external" href="http://hg.python.org/distutils2/">distutils2</a>
|
|
is over. It was a really amazing experience, for many reasons.</p>
|
|
<p>First of all, we had a very good team, we were 5 students working
|
|
on distutils2: <a class="reference external" href="http://zubin71.wordpress.com">Zubin</a>,
|
|
<a class="reference external" href="http://wokslog.wordpress.com/">Éric</a>,
|
|
<a class="reference external" href="http://gsoc.djolonga.com/">Josip</a>,
|
|
<a class="reference external" href="http://konryd.blogspot.com/">Konrad</a> and me. In addition,
|
|
<a class="reference external" href="http://mouadino.blogspot.com/">Mouad</a> have worked on the PyPI
|
|
testing infrastructure. You could find what each person have done
|
|
on
|
|
<a class="reference external" href="http://bitbucket.org/tarek/distutils2/wiki/GSoC_2010_teams">the wiki page of distutils2</a>.</p>
|
|
<p>We were in contact with each others really often, helping us when
|
|
possible (in #distutils), and were continuously aware of the state
|
|
of the work of each participant. This, in my opinion, have bring us
|
|
in a good shape.</p>
|
|
<p>Then, I've learned a lot. Python packaging was completely new to me
|
|
at the time of the GSoC start, and I was pretty unfamiliar with
|
|
python good practices too, as I've been introducing myself to
|
|
python in the late 2009.</p>
|
|
<p>I've recently looked at some python code I wrote just three months
|
|
ago, and I was amazed to think about many improvements to made on
|
|
it. I guess this is a good indicator of the path I've traveled
|
|
since I wrote it.</p>
|
|
<p>This summer was awesome because I've learned about python good
|
|
practices, now having some strong
|
|
<a class="reference external" href="http://mercurial.selenic.com/">mercurial</a> knowledge, and I've
|
|
seen a little how the python community works.</p>
|
|
<p>Then, I would like to say a big thanks to all the mentors that have
|
|
hanged around while needed, on IRC or via mail, and especially my
|
|
mentor for this summer, <a class="reference external" href="http://tarek.ziade.org">Tarek Ziadé</a>.</p>
|
|
<p>Thanks a lot for your motivation, your leadership and your
|
|
cheerfulness, even with a new-born and a new work!</p>
|
|
<div class="section" id="why">
|
|
<h2>Why ?</h2>
|
|
<p>I wanted to work on python packaging because, as the time pass, we
|
|
were having a sort of complex tools in this field. Each one wanted
|
|
to add features to distutils, but not in a standard way.</p>
|
|
<p>Now, we have PEPs that describes some format we agreed on (see PEP
|
|
345), and we wanted to have a tool on which users can base their
|
|
code on, that's <a class="reference external" href="http://hg.python.org/distutils2/">distutils2</a>.</p>
|
|
</div>
|
|
<div class="section" id="my-job">
|
|
<h2>My job</h2>
|
|
<p>I had to provides a way to crawl the PyPI indexes in a simple way,
|
|
and do some installation / uninstallation scripts.</p>
|
|
<p>All the work done is available in
|
|
<a class="reference external" href="http://bitbucket.org/ametaireau/distutils2/">my bitbucket repository</a>.</p>
|
|
<div class="section" id="crawling-the-pypi-indexes">
|
|
<h3>Crawling the PyPI indexes</h3>
|
|
<p>There are two ways of requesting informations from the indexes:
|
|
using the "simple" index, that is a kind of REST index, and using
|
|
XML-RPC.</p>
|
|
<p>I've done the two implementations, and a high level API to query
|
|
those twos. Basically, this supports the mirroring infrastructure
|
|
defined in PEP 381. So far, the work I've done is gonna be used in
|
|
pip (they've basically copy/paste the code, but this will change as
|
|
soon as we get something completely stable for distutils2), and
|
|
that's a good news, as it was the main reason for what I've done
|
|
that.</p>
|
|
<p>I've tried to have an unified API for the clients, to switch from
|
|
one to another implementation easily. I'm already thinking of
|
|
adding others crawlers to this stuff, and it was made to be
|
|
extensible.</p>
|
|
<p>If you want to get more informations about the crawlers/PyPI
|
|
clients, please refer to the distutils2 documentation, especially
|
|
<a class="reference external" href="http://distutils2.notmyidea.org/library/distutils2.index.html">the pages about indexes</a>.</p>
|
|
<p>You can find the changes I made about this in the
|
|
<a class="reference external" href="http://hg.python.org/distutils2/">distutils2</a> source code .</p>
|
|
</div>
|
|
<div class="section" id="installation-uninstallation-scripts">
|
|
<h3>Installation / Uninstallation scripts</h3>
|
|
<p>Next step was to think about an installation script, and an
|
|
uninstaller. I've not done the uninstaller part, and it's a smart
|
|
part, as it's basically removing some files from the system, so
|
|
I'll probably do it in a near future.</p>
|
|
<p><a class="reference external" href="http://hg.python.org/distutils2/">distutils2</a> provides a way to
|
|
install distributions, and to handle dependencies between releases.
|
|
For now, this support is only about the last version of the
|
|
METADATA (1.2) (See, the PEP 345), but I'm working on a
|
|
compatibility layer for the old metadata, and for the informations
|
|
provided via PIP requires.txt, for instance.</p>
|
|
</div>
|
|
<div class="section" id="extra-work">
|
|
<h3>Extra work</h3>
|
|
<p>Also, I've done some extra work. this includes:</p>
|
|
<ul class="simple">
|
|
<li>working on the PEP 345, and having some discussion about it
|
|
(about the names of some fields).</li>
|
|
<li>writing a PyPI server mock, useful for tests. you can find more
|
|
information about it on the
|
|
<a class="reference external" href="http://distutils.notmyidea.org">documentation</a>.</li>
|
|
</ul>
|
|
</div>
|
|
</div>
|
|
<div class="section" id="futures-plans">
|
|
<h2>Futures plans</h2>
|
|
<p>As I said, I've enjoyed working on distutils2, and the people I've
|
|
met here are really pleasant to work with. So I <em>want</em> to continue
|
|
contributing on python, and especially on python packaging, because
|
|
there is still a lot of things to do in this scope, to get
|
|
something really usable.</p>
|
|
<p>I'm not plainly satisfied by the work I've done, so I'll probably
|
|
tweak it a bit: the installer part is not yet completely finished,
|
|
and I want to add support for a real
|
|
<a class="reference external" href="http://en.wikipedia.org/wiki/Representational_State_Transfer">REST</a>
|
|
index in the future.</p>
|
|
<p>We'll talk again of this in the next months, probably, but we
|
|
definitely need a real
|
|
<a class="reference external" href="http://en.wikipedia.org/wiki/Representational_State_Transfer">REST</a>
|
|
API for <a class="reference external" href="http://pypi.python.org">PyPI</a>, as the "simple" index
|
|
<em>is</em> an ugly hack, in my opinion. I'll work on a serious
|
|
proposition about this, maybe involving
|
|
<a class="reference external" href="http://couchdb.org">CouchDB</a>, as it seems to be a good option
|
|
for what we want here.</p>
|
|
</div>
|
|
<div class="section" id="issues">
|
|
<h2>Issues</h2>
|
|
<p>I've encountered some issues during this summer. The main one is
|
|
that's hard to work remotely, especially being in the same room
|
|
that we live, with others. I like to just think about a project
|
|
with other people, a paper and a pencil, no computers. This have
|
|
been not so possible at the start of the project, as I needed to
|
|
read a lot of code to understand the codebase, and then to
|
|
read/write emails.</p>
|
|
<p>I've finally managed to work in an office, so good point for
|
|
home/office separation.</p>
|
|
<p>I'd not planned there will be so a high number of emails to read,
|
|
in order to follow what's up in the python world, and be a part of
|
|
the community seems to takes some times to read/write emails,
|
|
especially for those (like me) that arent so confortable with
|
|
english (but this had brought me some english fu !).</p>
|
|
</div>
|
|
<div class="section" id="thanks">
|
|
<h2>Thanks !</h2>
|
|
<p>A big thanks to <a class="reference external" href="http://www.graine-libre.fr/">Graine Libre</a> and
|
|
<a class="reference external" href="http://www.makina-corpus.com/">Makina Corpus</a>, which has offered
|
|
me to come into their offices from time to time, to share they
|
|
cheerfulness ! Many thanks too to the Google Summer of Code program
|
|
for setting up such an initiative. If you're a student, if you're
|
|
interested about FOSS, dont hesitate any second, it's a really good
|
|
opportunity to work on interesting projects!</p>
|
|
</div>
|
|
|
|
</div><!-- /.entry-content -->
|
|
|
|
<div class="comments">
|
|
<h2>Comments !</h2>
|
|
<div id="disqus_thread"></div>
|
|
<script type="text/javascript">
|
|
var disqus_identifier = "an-amazing-summer-of-code-working-on-distutils2.html";
|
|
(function() {
|
|
var dsq = document.createElement('script'); dsq.type = 'text/javascript'; dsq.async = true;
|
|
dsq.src = 'http://blog-notmyidea.disqus.com/embed.js';
|
|
(document.getElementsByTagName('head')[0] || document.getElementsByTagName('body')[0]).appendChild(dsq);
|
|
})();
|
|
</script>
|
|
</div>
|
|
|
|
|
|
</article>
|
|
</section>
|
|
|
|
<section id="extras" class="body">
|
|
|
|
<div class="blogroll">
|
|
<h2>blogroll</h2>
|
|
<ul>
|
|
|
|
<li><a href="http://biologeek.org">Biologeek</a></li>
|
|
|
|
<li><a href="http://filyb.info/">Filyb</a></li>
|
|
|
|
<li><a href="http://www.libert-fr.com">Libert-fr</a></li>
|
|
|
|
<li><a href="http://prendreuncafe.com/blog/">N1k0</a></li>
|
|
|
|
<li><a href="http://ziade.org/blog">Tarek Ziadé</a></li>
|
|
|
|
<li><a href="http://zubin71.wordpress.com/">Zubin Mithra</a></li>
|
|
|
|
</ul>
|
|
</div><!-- /.blogroll -->
|
|
|
|
|
|
<div class="social">
|
|
<h2>social</h2>
|
|
<ul>
|
|
<li><a href="./feeds/all.atom.xml" rel="alternate">atom feed</a></li>
|
|
|
|
|
|
|
|
<li><a href="http://twitter.com/ametaireau">twitter</a></li>
|
|
|
|
<li><a href="http://lastfm.com/user/akounet">lastfm</a></li>
|
|
|
|
<li><a href="http://github.com/ametaireau">github</a></li>
|
|
|
|
</ul>
|
|
</div><!-- /.social -->
|
|
|
|
</section><!-- /#extras -->
|
|
|
|
<footer id="contentinfo" class="body">
|
|
<address id="about" class="vcard body">
|
|
Proudly powered by <a href="http://alexis.notmyidea.org/pelican/">pelican</a>, which takes great advantages of <a href="http://python.org">python</a>.
|
|
</address><!-- /#about -->
|
|
|
|
<p>The theme is by <a href="http://coding.smashingmagazine.com/2009/08/04/designing-a-html-5-layout-from-scratch/">Smashing Magazine</a>, thanks!</p>
|
|
</footer><!-- /#contentinfo -->
|
|
|
|
|
|
|
|
|
|
<script type="text/javascript">
|
|
var disqus_shortname = 'blog-notmyidea';
|
|
(function () {
|
|
var s = document.createElement('script'); s.async = true;
|
|
s.type = 'text/javascript';
|
|
s.src = 'http://' + disqus_shortname + '.disqus.com/count.js';
|
|
(document.getElementsByTagName('HEAD')[0] || document.getElementsByTagName('BODY')[0]).appendChild(s);
|
|
}());
|
|
</script>
|
|
|
|
</body>
|
|
</html> |