ASDF 3
ASDF 3 is the current successor to Daniel Barlow's ASDF.
It was rewritten for improved portability, robustness, usability,
extensibility, configurability, internal consistency,
and the ability to deliver standalone executables.
Its notable versions include pre-release 2.27 on February 1st 2013,
first release 3.0.0 on May 15th 2013,
major release 3.1.2 on May 6th 2014,
and latest release 3.1.4 on October 10th 2014.
What it is
ASDF stands for Another System Definition Facility,
in the continuity of the Lisp DEFSYSTEM of yore.
ASDF 3 contains two parts: asdf/defsystem and uiop.
- asdf/defsystem
-
is a tool to describe how Lisp source code is organized in systems,
and how to build a system in term of actions that depend on previous actions.
Typical actions consist in compiling a Lisp source file (if not up to date)
and loading the resulting compilation output (if not both loaded and up to date).
And you must typically compile and load files that define packages, macros, variables,
before you may compile and load other files that use them.
It is roughly what Common Lisp hackers use to build and load software
where C hackers might use GNU Make to build software and
ld.so to load it.
asdf/defsystem is the part that people usually refer to as ASDF,
with uiop being only a supporting library,
that happens to be distributed at the same time, by necessity.
- uiop
-
also known as asdf/driver,
the Utilities for Implementation- and OS- Portability,
is a Common Lisp portability library and runtime support system
that helps you write Common Lisp software in a portable way.
In addition to many general-purpose Lisp utilities,
it notably provides portable abstractions to
gloss over implementation quirks, support hot-upgrade of code,
manipulate pathnames, create programs, use command-line arguments,
access the environment, use the filesystem,
call other programs and parse their output,
compile Lisp code, muffle conditions, or configure Lisp software.
See its
README.md for an overview,
and the documentation as extracted from its docstrings by
HEΛP
(beware: you can, though it's not obvious, scroll the list of packages
with a scroll the right of the top-left pane, and then click on the one
you're interested in to browse its symbols).
uiop is distributed as part of the ASDF,
its source code is transcluded in the single-file asdf.lisp being distributed
and the precompiled fasls provided by Lisp implementations.
ASDF relies heavily on it for its portability layer and runtime support,
particularly so as to handle pathnames and filesystem access.
uiop is useful on its own and can also be compiled and distributed separately.
What it is not
ASDF will not download missing software components for you.
For that, you want Quicklisp,
that builds upon ASDF, and is great for pulling and installing
tarballs of packages you may depend upon;
we also recommend clbuild,
that now builds upon Quicklisp, as a great tool for pulling from version control
packages you need to modify or want to contribute to.
We recommend you should not use asdf-install anymore,
as it is an older similar piece of software that is both unmaintained and obsolete.
ASDF is also not a tool to build or run Common Lisp software from the Unix command-line.
For that, you want cl-launch,
or perhaps buildapp.
If you're unsatisfied with ASDF,
beside helping with our
TODO list,
you might be interested in other build systems for Common-Lisp:
- Alastair Bridgewater's small and simple one-package-per-file
quick-build
(also reimplemented as the ASDF extension
asdf-package-system, now part of ASDF 3;
similar to faslpath below).
- François-René Rideau's
XCVB
(building object and image files deterministically and in parallel,
but not actively maintained since 2012;
a hypothetical ASDF 4 could conceivably be evolved to support these features
thanks to the groundwork laid by ASDF 3).
- Drew McDermott's
YTools
(the polar opposite, trying to maintain coherence
of the current Lisp image at a fine grain).
- Dmitriy Ivanov's
ASDlite
(a somewhat improved incompatible variant of ASDF 1, less featureful than ASDF 3),
- Mark Kantrowitz's
mk-defsystem
(free software successor of the old proprietary DEFSYSTEM's
and predecessor of ASDF, obsolete),
- Sean Ross's
mudballs
(an attempt at making things cleaner than in ASDF 2, aborted),
- Peter von Etter's
faslpath
(a much simpler system establishing a mapping between packages and files,
abandoned but see asdf-package-system and quick-build above).
- Alexander Kahl's
evol
(a reimplementation in Lisp of the GNU autotools stack, abandoned),
There are probably more.
However, none of these systems seems to ever have had the traction of ASDF,
probably because none was technically superior enough (when at all)
to compensate for the first mover advantage.
Supported Implementations
ASDF 3 now supports all CL implementations
that seem to have any current user base, and then some.
Most implementations provide ASDF as a module,
and you can simply (require "asdf").
(All of them but CLISP also accept
:asdf, "ASDF" or 'asdf as an argument.)
Most of these implementations provide ASDF 3.
Some implementations don't provide ASDF 3 yet,
but have announced they will in their next release.
As for remaining implementations,
they are obsolete and/or mostly unmaintained.
|
Provide ASDF 3 |
Will provide ASDF 3 |
Unmaintained |
|---|
| Free |
abcl ccl clasp clisp cmucl ecl mkcl sbcl |
gcl |
mcl xcl |
|---|
| Proprietary |
allegro lispworks |
|
cormanlisp genera mocl scl |
|---|
To deal with an old implementation that didn't yet provide ASDF 3,
we provide a script
that can install ASDF 3 where your implementation goes looking for it
when you (require "asdf") .
Note that upgrading from an old version of ASDF is possible,
but quite complex to do right in a robust way, and we do not recommend it.
Also note that mocl only supports a heavily modified variant of ASDF 2,
and will require robust cross-compilation support to be added to ASDF 3
before it is actually supported.
If there is an old or new implementation that we are missing,
it shouldn't be hard to adapt ASDF to support it.
Ask us!
Examples
Download any of the many packages available through
Quicklisp
to see as many examples.
Documentation
You can read our manual:
Regarding the internal design of ASDF in general,
and the work we did on ASDF 3,
see the extended version (26 pages) of our paper
ASDF 3, or Why Lisp is Now an Acceptable Scripting Language
(PDF,
git).
The shorter version (8 pages), submitted to
ELS 2014,
focuses on ASDF 3 and misses historical and technical information
(PDF,
HTML).
Regarding ASDF 3, see also the slides of the
ASDF 3 tutorial presented at ELS 2013,
and for an introduction to the source code, this video:
ASDF 3.1 walkthrough.
For more details about our work on ASDF 2,
see the last draft version of our paper for
ILC 2010,
Evolving ASDF: More Cooperation, Less Coordination
(git).
Finally, while the manual covers all the basics,
some advanced or new features remain underdocumented.
Please contact our mailing-list (see below)
for any issue that isn't well-documented enough.
Until we write more documentation on the further innovations of ASDF 3,
the documentation strings, the source code, the changelog and the git log
are unfortunately your best chances for discovering the available functionality.
Getting it
Though they may lag behind the version here, ASDF comes bundled with most Lisps.
To get the greatest and latest, you can:
Extensions
Known extensions to ASDF include:
- asdf-encodings,
to compile Lisp source files with character encodings other than UTF-8.
- asdf-finalizers,
to allow macros to include code to be evaluated
at the end of a file being compiled.
-
asdf-dependency-grovel,
to compute the actual dependencies in a big ASDF system.
- poiu,
to compile a system in parallel on a multiprocessor machine.
- asdf-system-connections,
lets you specify systems that are automatically loaded when
two other systems are loaded, to connect them.
- asdf-flv,
to bind file-local variables around the compilation of some files.
Former extensions, now superseded, include:
- asdf-binary-locations
used to allow one to redirect where ASDF 1 created its output files,
so they don't clash between implementations and don't pollute source directories.
It is superseded by asdf/defsystem's builtin
asdf-output-translations mechanism;
a limited compatibility mode is available to easily convert
your former ABL configuration into an AOT configuration.
common-lisp-controller and cl-launch
used to provide similar mechanisms,
and have also been superseded by asdf-output-translations
(built into ASDF 2 and later).
- asdf-bundle, née asdf-ecl,
allowed you to create a single-file bundle out of a system,
for easier delivery.
It is now a builtin part of asdf/defsystem,
and allows users to deliver a single FASL for a system,
a standalone executable program (on supported implementations),
or an image containing your system precompiled.
- asdf-condition-control, initially part of XCVB's xcvb-driver,
allowed you to muffle uninteresting conditions during compilation.
Is now superseded by equivalent functionality in uiop.
- asdf-contrib,
an empty package that used to collect dependencies on other systems
in the list above and below.
- asdf-package-system,
to compile Lisp source files with one package per file
that also determines dependencies, in the style of
quick-build or
faslpath
(this functionality is built into recent versions of ASDF 3.1 and later,
but this package exists for backward compatibility with earlier versions of ASDF 3;
search the manual for package-inferred-system).
- asdf-utils was a collection of utilities that originated with ASDF.
It is now superseded by uiop, aka asdf/driver,
which is part of ASDF,
and exports its functionality
in its own package uiop.
Contributing
Join our mailing list, check the code out from git,
send questions, ideas and patches!
Reporting Bugs
To report bugs, you can use our
launchpad project.
If you're unsure about the bug or want to discuss how to fix it,
you can send email to the project mailing-list below.
Mailing Lists
- asdf-devel
A list for questions, suggestions, bug reports, patches, and so on.
It's for everyone and everything. Please join the conversation!
asdf-devel
mailman site to subscribe
- asdf-announce
A low-volume mailing-list for announcements only, mostly regarding new releases.
Posting is restricted to project administrators and to important notices.
Please subscribe to it if you're a Lisp implementation or distribution vendor,
who needs to know when to upgrade the ASDF you distribute,
but are otherwise not interested in day to day design and
development.
asdf-announce
mailman site to subscribe
Contributing
Join our mailing list, check the code out from git,
send questions, ideas and patches!
What is happening
- May 2015
- With the LispWorks 7.0 release, all actively maintained CL implementations
are now providind ASDF 3.0 or later, and
support for older variants is now officially dropped.
- October 2014
- More bug fixing leads to release of 3.1.4 on 10 October 2014.
There should be no incompatibilities. See the Changelog for more details.
- August 2014
- The ASDF mailing lists have been reestablished, in particular
asdf-announce, which should allow CL implementers better access to only
the information they want about ASDF development.
- May 2014 to July 2014
- ASDF bug fixing from 3.1.2 leads to release of 3.1.3, a major bug
fix release. We strongly urge implementors that have shipped with 3.1.2
to upgrade to 3.1.3. There should be no incompatibilities, and some
very important bug fixes are provided. See the Changelog for more details.
- July 2013 to May 2014
- François-René Rideau has resigned as maintainer
but remained an active developer.
Robert P. Goldman is interim maintainer until someone more gifted,
charming, dedicated, and better-looking can be secured to fill the role.
ASDF 3.0.2 was released in July 2013, 3.0.3 in October 2013, and 3.1.2 in May 2014.
In addition to significant improvements and bug fixes,
notably better Windows support,
ASDF 3.1.2 notably sports the package-inferred-system extension.
- November 2012 to June 2013
-
François-René Rideau completely rewrites ASDF
and publishes ASDF 3, pre-released as 2.27 in February 2013,
and released as 3.0.1 in May 2013.
It now includes both the traditional asdf/defsystem
and a formalized portability library uiop (née asdf/driver).
asdf/defsystem is a backward-compatible reimplementation of ASDF
with correct timestamp propagation based on a consistent dependency model,
and featuring support for bundle output, deferred warnings check, and more.
uiop provides many abstractions to write portable Common Lisp programs.
Last version: 3.0.1.
- December 2009 to October 2012
- François-René Rideau is de facto maintainer,
with notable contributions from Robert P. Goldman, but also
Juanjo Garcia-Ripoll and James Anderson.
ASDF 2.000 is released in May 2010
with many clean-ups, better configurability, some new features,
and updated documentation.
The ASDF 2 series culminates with ASDF 2.26 in October 2012,
which in addition to many bug fixes and small features
includes support for file encodings, around-compile and compile-check hooks.
Last version: 2.26.
- May 2006 to November 2009
- Gary King is de facto maintainer,
with notable contributions from
Robert P. Goldman, Nikodemus Siivola, Christophe Rhodes, Daniel Herring.
Many small features and bug fixes,
making the project more maintainable,
moving to using git and common-lisp.net.
Last version: 1.369.
- May 2004 to April 2006
- Christophe Rhodes is de facto maintainer,
with notable contributions from
Nikodemus Siivola, Peter Van Eynde, Edi Weitz, Kevin Rosenberg.
The system made slightly more robust, a few more features.
Last version: 1.97.
- August 2001 to May 2004
- Created then developed by Daniel Barlow, with notable contributions from
Christophe Rhodes, Kevin Rosenberg, Edi Weitz, Rahul Jain.
Last version: 1.85.
