2023-09-15 06:31:46 +00:00
|
|
|
---
|
|
|
|
title: lbmk coding style and design
|
|
|
|
x-toc-enable: true
|
|
|
|
...
|
|
|
|
|
|
|
|
This document is extremely new, and may change rapidly.
|
|
|
|
|
|
|
|
For context, please also read the main [lbmk maintenance manual](index.md).
|
|
|
|
|
|
|
|
You should *read* the logic in lbmk yourself, to really know what is meant by
|
|
|
|
some of the concepts explained here. This article will no doubt be incomplete,
|
|
|
|
and several practises may persist in spite of it; nonetheless, this article
|
|
|
|
shall serve as a reference for lbmk development.
|
|
|
|
|
2023-09-15 06:44:12 +00:00
|
|
|
NO BASHISMS
|
|
|
|
===========
|
|
|
|
|
|
|
|
Libreboot's build system was previously written in Bash, and actually used
|
|
|
|
Bash-specific behaviour. This was later *corrected*, thanks largely to work
|
|
|
|
done by Ferass El Hafidi.
|
|
|
|
|
|
|
|
Here is an *excellent* introduction to posix `sh` scripting:
|
2023-09-15 06:46:41 +00:00
|
|
|
<https://pubs.opengroup.org/onlinepubs/009604499/utilities/xcu_chap02.html>
|
2023-09-15 06:44:12 +00:00
|
|
|
|
|
|
|
and an even more excellent introduction:
|
|
|
|
<https://vermaden.wordpress.com/ghost-in-the-shell/>
|
|
|
|
(seriously, it's good. Read it!)
|
|
|
|
|
2023-09-15 06:31:46 +00:00
|
|
|
Design
|
|
|
|
======
|
|
|
|
|
|
|
|
Libreboot's build system design is very simple: put as much as possible
|
|
|
|
under `config/`, and keep actual logic to a minimum.
|
|
|
|
|
2023-09-15 06:50:04 +00:00
|
|
|
You can read about that design in the [lbmk maintenance manual](index.md).
|
|
|
|
|
2023-09-15 06:31:46 +00:00
|
|
|
No Makefiles
|
|
|
|
------------
|
|
|
|
|
|
|
|
We have Makefiles in some C programs, under `util/`, and projects that we import
|
|
|
|
may use Makefiles, but lbmk itself does not contain any Makefiles. Instead, we
|
|
|
|
do everything in shell scripts.
|
|
|
|
|
|
|
|
This approach has certain drawbacks, but for the most part it ensures that the
|
|
|
|
code is more readable. It's easier to implement a cleaner coding style, which
|
|
|
|
the next sections will cover.
|
|
|
|
|
|
|
|
Coding style
|
|
|
|
============
|
|
|
|
|
|
|
|
Read <https://man.openbsd.org/style.9> and go read a few userland program source
|
|
|
|
trees in OpenBSD's main CVS tree. This is the style that inspires the lbmk
|
|
|
|
coding style; OpenBSD's style pertains to C programming, and it has been adapted
|
|
|
|
for shell scripts in the Libreboot build system, lbmk.
|
|
|
|
|
|
|
|
You should read the OpenBSD style and go read OpenBSD utils, especially userland
|
|
|
|
programs like `cat` or `ls` in the OpenBSD `src` tree.
|
|
|
|
|
|
|
|
Libreboot scripts, and also C programs like `nvmutil`, are heavily inspired by
|
|
|
|
this style. We insist on its use, because this style is extremely readable and
|
|
|
|
forces you to write better code.
|
|
|
|
|
|
|
|
main on top
|
|
|
|
-----------
|
|
|
|
|
|
|
|
In every lbmk script, it is our intention that there be a `main()` function.
|
|
|
|
All logic should be inside a function, and `main()` should be the function that
|
|
|
|
executes first; at the bottom of each script, insert this line:
|
|
|
|
|
|
|
|
main $@
|
|
|
|
|
|
|
|
This will execute `main()`, passing any arguments (from the user's shell) to it.
|
|
|
|
|
|
|
|
Top-down logic
|
|
|
|
--------------
|
|
|
|
|
|
|
|
*Every* function called from main should always be *below* the calling function.
|
|
|
|
Therefore, if multiple functions call a given function, that function should be
|
|
|
|
below the final one that called it. Here is an example (please also pay
|
|
|
|
attention to how the functions are formatted, e.g. where `{` and `}` go:
|
|
|
|
|
|
|
|
```
|
|
|
|
#!/usr/bin/env sh
|
|
|
|
|
2023-09-15 07:04:41 +00:00
|
|
|
. "include/err.sh"
|
|
|
|
|
2023-09-15 06:31:46 +00:00
|
|
|
main()
|
|
|
|
{
|
2023-09-15 06:42:44 +00:00
|
|
|
foo
|
|
|
|
bar
|
|
|
|
do_something_else
|
2023-09-15 06:31:46 +00:00
|
|
|
}
|
|
|
|
|
|
|
|
foo()
|
|
|
|
{
|
|
|
|
printf "I'm a function that does stuff.\n"
|
2023-09-15 06:42:44 +00:00
|
|
|
bar || err "foo: an error occured"
|
2023-09-15 06:31:46 +00:00
|
|
|
do_something_else
|
|
|
|
}
|
|
|
|
|
|
|
|
bar()
|
|
|
|
{
|
|
|
|
printf "I'm another function that does stuff.\n"
|
2023-09-15 06:42:44 +00:00
|
|
|
some_other_command || printf "WARNING: bar: something something" 1>&2
|
2023-09-15 06:31:46 +00:00
|
|
|
}
|
|
|
|
|
|
|
|
do_something_else()
|
|
|
|
{
|
2023-09-15 06:42:44 +00:00
|
|
|
complicated_function bla bla bla || \
|
|
|
|
err "do_something_else: something happened that wasn't nice"
|
2023-09-15 06:31:46 +00:00
|
|
|
}
|
|
|
|
|
|
|
|
complicated_function()
|
|
|
|
{
|
|
|
|
printf "I'm a complicated function, provided as helper"
|
|
|
|
printf " function for do_something_else()\n"
|
2023-09-15 06:42:44 +00:00
|
|
|
|
|
|
|
do_some_complicated_stuff || return 1
|
2023-09-15 06:31:46 +00:00
|
|
|
}
|
|
|
|
|
|
|
|
main $@
|
|
|
|
```
|
|
|
|
|
2023-09-15 07:04:41 +00:00
|
|
|
PWD is always root of lbmk
|
|
|
|
--------------------------
|
|
|
|
|
|
|
|
In any script executed by lbmk, under `script/`, the work directory is relative
|
|
|
|
to the main `lbmk` script. In other words, all scripts under `script/` also
|
|
|
|
assume this.
|
|
|
|
|
|
|
|
This is actually one of the reasons for that design, as also alluded to in
|
|
|
|
the main [lbmk maintenance manual](index.md).
|
|
|
|
|
2023-09-15 06:31:46 +00:00
|
|
|
main should only be a simple skeleton
|
|
|
|
-------------------------------------
|
|
|
|
|
|
|
|
The `main()` function should not implement much logic itself. Each script in
|
|
|
|
lbmk is its own program. The `main()` function should contain the overall
|
|
|
|
structure of the entire logic, with subfunctions providing actual functionality.
|
|
|
|
|
|
|
|
Subfunctions can then have their own subfunctions, declared below themselves, in
|
|
|
|
this top-down style. For example, a function that builds SeaBIOS payloads might
|
|
|
|
be below a function that builds ROM images with SeaBIOS payloads inside them,
|
|
|
|
when building coreboot ROM images.
|
|
|
|
|
|
|
|
One task, one script
|
|
|
|
====================
|
|
|
|
|
|
|
|
Not literally *one task*, but one theme, one *kind* of overall task. For
|
2023-10-10 21:07:39 +00:00
|
|
|
example, `script/build/fw/coreboot` builds final ROM images of coreboot,
|
2023-09-15 06:31:46 +00:00
|
|
|
containing payloads; that same script does not also build cross compilers or
|
|
|
|
tell you the current weather forecast. This is an analog of the Unix design
|
|
|
|
philosophy which says: write one program that does one thing well, and then
|
|
|
|
another program that does another thing very well; programs communicate with
|
|
|
|
each other via the universal method, namely text.
|
|
|
|
|
|
|
|
Error handling
|
|
|
|
==============
|
|
|
|
|
|
|
|
Where feasible, a script should do:
|
|
|
|
|
|
|
|
set -e -u
|
|
|
|
|
|
|
|
If `-e` isn't feasible, perhaps try just `-u` - if neither is feasible, then
|
|
|
|
that is OK. Judge it case by case.
|
|
|
|
|
|
|
|
However, neither of these should be relied upon exclusively. When a script runs
|
|
|
|
*any* kind of command that could return with error status, that error status
|
|
|
|
must be handled.
|
|
|
|
|
|
|
|
The general rule is to call `err()`, which is provided in lbmk by
|
|
|
|
the file `include/err.sh`. This is inspired by the way `err()` is called in
|
|
|
|
BSD programs (from `err.h`, a non-standard BSD libc extension).
|
|
|
|
|
|
|
|
Where a script must perform certain cleanup before exiting, the script should
|
|
|
|
implement its own `fail()` function that performs cleanup, and then
|
|
|
|
calls `err()`. The `err()` function takes a string as argument, which will be
|
|
|
|
printed to the screen.
|
|
|
|
|
|
|
|
If `err` is being called from `main()`, just write the error message. However,
|
|
|
|
if it's being called from another function, you should write the function name.
|
|
|
|
For example:
|
|
|
|
|
|
|
|
err "function_name: this shit doesn't work. fix it."
|
|
|
|
|
|
|
|
Do not directly exit
|
|
|
|
--------------------
|
|
|
|
|
|
|
|
Please try to use `err` for all error exits.
|
|
|
|
|
|
|
|
The main `lbmk` script has its own exit function, for handling zero or non-zero
|
|
|
|
exits. Zero means success, and non-zero means error.
|
|
|
|
|
|
|
|
A script should either return zero status, or call `err()`.
|
|
|
|
|
|
|
|
An individual function may, in some cases, return 1 or 0 itself, which would
|
|
|
|
then be handled accordingly by the calling function.
|
|
|
|
|
|
|
|
How to handle errors
|
|
|
|
--------------------
|
|
|
|
|
|
|
|
There are some instances where errors should be *ignored*, in which case you
|
|
|
|
might do:
|
|
|
|
|
|
|
|
command || :
|
|
|
|
|
|
|
|
The `||` means: if `command` exits with non-zero (error) status, do this, and
|
|
|
|
then after the `||` is what to do: similarly, `&&` instead would mean: if the
|
|
|
|
command succeeded, then do this.
|
|
|
|
|
|
|
|
Never mix `&&` and `||`
|
|
|
|
|
|
|
|
If/else blocks
|
|
|
|
==============
|
|
|
|
|
|
|
|
Keep these simple, and where possible, maybe don't use them at all! For
|
|
|
|
example:
|
|
|
|
|
|
|
|
```
|
|
|
|
if [ "${var}" = "foo" ]; then
|
|
|
|
do_something
|
|
|
|
fi
|
|
|
|
```
|
|
|
|
|
|
|
|
You might instead do:
|
|
|
|
|
|
|
|
```
|
|
|
|
[ "${var}" != "foo" ] || \
|
|
|
|
do_something
|
|
|
|
```
|
|
|
|
|
|
|
|
or
|
|
|
|
|
|
|
|
```
|
|
|
|
[ "${var}" = "foo" ] && \
|
|
|
|
do something
|
|
|
|
```
|
|
|
|
|
|
|
|
Warnings
|
|
|
|
--------
|
|
|
|
|
|
|
|
In C, the `stderr` file is 2 as represented by `int fd` style. In shell scripts,
|
|
|
|
it's the same: 1 for standard output, 2 for errors/warnings. The `err` function
|
|
|
|
in lbmk writes to 2 (stderr).
|
|
|
|
|
|
|
|
If you want to output something that is a warning, or otherwise an error that
|
|
|
|
should not yield an exit, you should do something like this:
|
|
|
|
|
|
|
|
printf "function_name: this is dodgy stuff. fix it maybe?\n" 1>&2
|
|
|
|
|
|
|
|
Avoid passing arguments excessively
|
|
|
|
===================================
|
|
|
|
|
|
|
|
In functions, use of arguments passed to them can be useful, but in general,
|
|
|
|
they should be avoided; use global variables when feasible.
|
|
|
|
|
|
|
|
Do not exceed 80 characters per line
|
|
|
|
====================================
|
|
|
|
|
|
|
|
See: RFC 3676
|
|
|
|
|
|
|
|
Excessively long code lines are really annoying to read.
|
|
|
|
|
|
|
|
Use tab-based indendation
|
|
|
|
=========================
|
|
|
|
|
|
|
|
A new line should begin with tab indentation, in a function.
|
|
|
|
|
|
|
|
Multi-line commands
|
|
|
|
-------------------
|
|
|
|
|
|
|
|
Use \\ at the end, as you would, but use *four spaces* to indent on the
|
|
|
|
follow-up line. For example:
|
|
|
|
|
|
|
|
```
|
|
|
|
function_name()
|
|
|
|
{
|
|
|
|
really stupidly long command that may also return error state || \
|
|
|
|
err "function_name: you fucked up. try again."
|
|
|
|
}
|
|
|
|
```
|
|
|
|
|
|
|
|
Use printf!
|
|
|
|
===========
|
|
|
|
|
|
|
|
Don't use `echo` unless there's some compelling reason to do so.
|
|
|
|
|
|
|
|
The `printf` functionality is more standard, across various sh implementations.
|
|
|
|
|
|
|
|
env
|
|
|
|
===
|
|
|
|
|
|
|
|
Don't do:
|
|
|
|
|
|
|
|
#!/bin/sh
|
|
|
|
|
|
|
|
Do:
|
|
|
|
|
|
|
|
#!/usr/bin/env sh
|
|
|
|
|
|
|
|
This is more portable, between various Unix systems.
|
|
|
|
|
|
|
|
Be portable!
|
|
|
|
============
|
|
|
|
|
|
|
|
In addition to not using bashisms, commands that lbmk uses must also
|
|
|
|
be portable; where possible, third party projects should be tweaked.
|
|
|
|
|
|
|
|
This is actually something that is currently lacking or otherwise untested
|
|
|
|
in Libreboot; it's currently assumed that only Linux (specifically GNU+Linux)
|
|
|
|
will work, because many of the projects that Libreboot makes use of will use
|
|
|
|
bashisms, or other GNUisms (e.g. GNU-specific C extensions or GNU Make specific
|
|
|
|
behaviour in Makefiles).
|
|
|
|
|
|
|
|
Work+testing is sorely needed, in this area. It would be nice if Libreboot
|
|
|
|
could be built on BSD systems, for example.
|
|
|
|
|
|
|
|
Do as little as possible
|
|
|
|
========================
|
|
|
|
|
|
|
|
Don't over-engineer anything. Write as simply as you can, to perform a single
|
|
|
|
task. This is basically the same as what has been written elsewhere, but it's
|
|
|
|
re-stated this way to illustrate a point:
|
|
|
|
|
|
|
|
Libreboot's build system is designed to be as efficient as possible. It
|
|
|
|
intentionally *avoids* implementing many things that are unnecessary for the
|
|
|
|
user. The purpose of Libreboot is to provide coreboot ROM images as efficiently
|
|
|
|
as possible, with desirable configurations that users want. Do that in as few
|
|
|
|
steps as possible, in the most streamlined way possible, while still providing
|
|
|
|
a degree of configurability - this is the mentality behind lbmk design.
|