lbwww/site/docs/maintain/index.md

1432 lines
59 KiB
Markdown
Raw Normal View History

2022-01-03 22:29:31 +00:00
---
title: lbmk maintenance manual
2022-01-03 22:29:31 +00:00
x-toc-enable: true
...
In addition to this manual, you should also refer to [porting.md](porting.md)
and [testing.md](testing.md).
Please also read about the [lbmk coding style and design](style.md).
Automated coreboot build system
===============================
This document describes the entire Libreboot build system, its design philosophy
and how it's used to prepare Libreboot releases; it is provided as a *reference*
for *Libreboot development*, pertaining to the current development branch of
Libreboot's build system (called *lbmk*).
The homepage of Libreboot says that Libreboot is a *coreboot distro*, providing
the necessary integration of coreboot, payloads and utilities so as to provide
releases, much like Linux distros do for your operating system, but here we are
concerned about the *boot firmware* instead. Libreboot is to coreboot, what
Debian is to Linux. It provides easier, more automated configuration and
installation.
The build system, lbmk, *is* that coreboot distro, at its very core. You can
basically think of it as a package manager; it is even a *source-based* package
manager. If you simply want to build ROM images, refer instead to the [basic
build instructions](../build/).
This build system, lbmk, is completely automated in every way. It is designed
to take care of itself; so long as build dependencies are installed, it will
check itself when running *any* command; if another command had to be executed
first, it will do so automatically. Therefore, you can run any part of lbmk
on its own, and the entire design is modular.
Best practises for learning lbmk
================================
The follow sections will cover subdirectories, within lbmk. Contrary to what
some may otherwise assume, it's best to learn about everything *except* scripts
or code within Libreboot, first. No, you should first learn about config files
used in the Libreboot build system, and *then* learn about the logic. By doing
it in this order, you will have greater context later when reading about those
scripts. Learning about each upstream project (such as coreboot) will also be
useful; check documentation provided by each project.
After learning about configuration, you will then read about files and
directories generated by the build system; only *then* will this document
describe each script or program that forms part of the build system. In other
words, this document adopts a *top-down* approach to education, rather than
bottom-up; most documents take the latter approach, in other projects, but
most people naturally want to learn how a specific thing works first, hence
the approach taken here.
Don't be deceived by simplicity
-------------------------------
Libreboot's build system is powerful, and highly configurable, yet deceptively
simple at the same time. Remember this rule, a rule that applies to *all*
software projects: code equals bugs, so smaller codebases will yield fewer bugs.
Libreboot is [regularly](../../news/audit.md) [audited](../../news/audit2.md).
Many people will be shocked by how *small* Libreboot is, at its core. You will
be surprised by just how much can be done with so little. Continue reading!
2022-01-03 22:29:31 +00:00
libreboot blob reduction policy
2022-11-13 21:12:15 +00:00
============================
2022-01-03 22:29:31 +00:00
The coreboot software is nominally free, but it requires additional files from
the vendor on many supported systems. These programs lack source code, and the
2022-11-13 21:12:15 +00:00
coreboot project does not control them, but they can be used to perform
specific initialization tasks.
2022-01-03 22:29:31 +00:00
The libreboot project *allows* vendor code within coreboot, but there is *still* a
2022-11-13 21:12:15 +00:00
lot of nuance to precisely what is allowed. It is important that you understand
these nuances, when working on *libreboot*.
2022-01-03 22:29:31 +00:00
[Please read the blob reduction guidelines](../../news/policy.md) and also
the [freedom status page](../../freedom-status.md).
2023-04-10 04:56:52 +00:00
Before *configuration* info, you will first be shown a brief overview of every
project that Libreboot imports, such as coreboot.
2023-04-10 04:56:52 +00:00
Projects/files downloaded/generated by lbmk
===========================================
2023-04-10 04:56:52 +00:00
The following sections will describe files and directories that are not
included in `lbmk.git`, but *are* created by running various lbmk commands;
many of these will also be provided, pre-generated, under release archives.
2023-04-10 04:56:52 +00:00
Some of these are *downloaded* by Libreboot's build system, automatically, while
others are created during the build process based on these downloaded programs.
2023-04-10 04:56:52 +00:00
bin/
---------------
2022-01-03 22:29:31 +00:00
This directory is created when running any of the following commands, with the
right arguments:
2022-01-03 22:29:31 +00:00
./build roms ARGUMENTS_HERE
./build serprog stm32
./build serprog rp2040
2023-04-10 04:56:52 +00:00
Simply speaking, `bin/` shall contain finished ROM images or firmware, that
can then be installed (flashed) to the target device.
2023-04-10 04:56:52 +00:00
The files under `bin/` are provided in regular Libreboot releases.
2023-04-10 04:56:52 +00:00
**These** are the ROM images that you should flash. Do *not* flash the ROM
images contained under `elf/`!
2023-04-10 04:56:52 +00:00
cbutils/
---------------
2023-04-10 04:56:52 +00:00
The build system compiles `cbfstool` and `ifdtool`, from coreboot, and then
places the executables here for use on coreboot ROM images.
2023-04-10 04:56:52 +00:00
ec/
---------------
2022-01-03 22:29:31 +00:00
KBC1126 EC firmware goes here, required on HP EliteBook laptops. These images
are inserted into those coreboot images, under `elf/` *and* `bin/`.
2022-01-03 22:29:31 +00:00
elf/
---------------
2022-01-03 22:29:31 +00:00
**DO NOT flash coreboot ROM images contained under `elf/`. Please use ROM images
under `bin/` instead!**
Compiled binaries (compiled by lbmk) go here, but they are not the final
binaries; coreboot ROM images are compiled without payloads, then cached here
under `elf/coreboot` as one example; ditto GRUB and SeaBIOS which go
under `elf/grub` and `elf/seabios` respectively - `elf/u-boot` is another
example.
2022-01-03 22:29:31 +00:00
Binaries under `elf/` are compiled first, which lbmk then uses to generate
the files under `bin/`; the latter files under `bin/` are intended for
installation by the user.
2022-01-03 22:29:31 +00:00
It is technically possible to re-use these files elsewhere. For example, you
may wish to only compile GRUB with lbmk, and then use the `grub.elf` file from
lbmk in your own custom coreboot ROM (that you didn't build with lbmk).
2022-01-03 22:29:31 +00:00
This is only used by the build system, but these images are *not* provided in
releases (only the images under `bin/` are provided).
2022-01-03 22:29:31 +00:00
mrc/
---------------
Please also
visit: <https://doc.coreboot.org/northbridge/intel/haswell/mrc.bin.html> - the
handling of this, in Libreboot, is based largely on the information there.
This contains the Intel MRC firmware, auto-downloaded during build
by `script/vendor/download`.
In some cases, libre MRC firmware is also available, and provided
by Libreboot as an alternative choice.
pciroms/
---------------
PCI Option ROMs, currently used only for the VGA ROM on models of Dell Latitude
E6400 containing an Nvidia GPU; it provides video initialisation, where coreboot
currently only initialises Intel GPUs natively, on Libreboot systems.
release/
---------------
The script at `script/update/release` create tarballs in here, which
constitute regular Libreboot releases. It is meticulously maintained, as per
current lbmk behaviour, and executed so as to provide Libreboot release
archives.
This provides source tarballs, and ROM images for example; however, ROM images
containing non-redistributable vendor code are *scrubbed* such that these files must,
in regular releases, be [re-added manually](../install/ivy_has_common.md) by
the user.
src/
----
Third-party source trees are downloaded into this directory, by lbmk.
src/bios\_extract/
---------------
Used by the vendor file handler scripts. The upstream that we use is here:
<https://review.coreboot.org/bios_extract>
Specifically: the pfs extract utility from this is used on Dell vendor updates,
to extract SCH5545 EC (Environment Control) firmware.
src/biosutilities/
---------------
Used by the vendor file handler scripts. The upstream that we use is here:
<https://github.com/platomav/BIOSUtilities>
The `dell_inspiron_1100_unpacker.py` script is used here, to extract from Dell
BIOS updates, to get at the VGA ROM for Nvidia GPU on certain models of Dell
Latitude E6400.
src/coreboot/
---------------
Please also visit: <https://coreboot.org/>
Coreboot is the main boot firmware, providing hardware initialisation. Libreboot
makes extensive use of coreboot, on supported mainboards.
Coreboot trees go here. Libreboot's build system does not simply use one tree,
or multiple branches in the same tree; entirely separate directories are
created, for each revision of coreboot used, each able to have its own patches.
These can then be re-use appropriately, per mainboard. For example:
* `src/coreboot/default` is used by most mainboards.
* `src/coreboot/cros` is used by cros devices.
This may be less efficient on disk usage, but it simplifies the logic greatly.
Coreboot also uses its own toolchain called *crossgcc*, and crossgcc is in fact
compiled *per tree* in Libreboot.
src/flashrom/
---------------
2022-01-03 22:29:31 +00:00
Please also visit: <https://flashrom.org/>
2023-01-08 01:22:04 +00:00
Although currently unused by any part of lbmk, we provide flashrom for the
convenience of users, and this is copied to release archives. Flashrom is the
program that you will use to read, erase and write the flash, containing
coreboot firmware.
2022-01-03 22:29:31 +00:00
src/grub/
---------------
2022-01-03 22:29:31 +00:00
Please also visit: <https://www.gnu.org/software/grub/>
2022-01-03 22:29:31 +00:00
The GNU GRUB bootloader, a reference multiboot implementation with its own
small kernel/OS and drivers (e.g. file systems, cryptography). This is the
default recommended [coreboot payload](https://doc.coreboot.org/payloads.html)
on x86-based Libreboot systems. GRUB will load and execute your Linux kernel,
which then runs on the bare metal.
2022-01-03 22:29:31 +00:00
The *utilities* for GRUB are compiled here, and used from here; specifically,
the `grub-mkstandalone` utility is executed from here to create the final
GRUB image under `elf/grub/`.
2022-01-03 22:29:31 +00:00
NOTE: This is *only* provided for x86 machines, in Libreboot. For ARM, we ship
U-Boot instead.
2022-01-03 22:29:31 +00:00
src/me\_cleaner/
---------------
2022-01-03 22:29:31 +00:00
Please also visit: <https://github.com/corna/me_cleaner/>
2022-01-03 22:29:31 +00:00
This is used by Libreboot, to *neuter* Intel ME images. The intel ME images
are auto-downloaded from the vendor during each build process, cached on
disk and processed by `me_cleaner`. It removes almost all code from Intel ME,
leaving only the basic bringup code (analogous to running coreboot without a
payload). More information available at these pages:
2022-01-03 22:29:31 +00:00
* <https://github.com/corna/me_cleaner/>
* Libreboot [freedom status page](../../freedom-status.md)
2022-01-03 22:29:31 +00:00
The *vendor file* scripts are what handle this, specifically the download script
located at `script/vendor/download`.
2022-01-03 22:29:31 +00:00
src/memtest86plus/
---------------
2022-01-03 22:29:31 +00:00
Please also visit: <https://www.memtest.org/>
2022-01-03 22:29:31 +00:00
This is provided inside ROM images, as a payload executed from main GRUB or
SeaBIOS payload. It checks for corrupted memory.
2022-01-03 22:29:31 +00:00
src/seabios/
---------------
2022-01-03 22:29:31 +00:00
Please also visit: <https://www.seabios.org/SeaBIOS>
2022-01-03 22:29:31 +00:00
This is the PC BIOS implementation used by Libreboot, on x86 machines (not all
of them). A BIOS/UEFI implementation is not required, because Linux and BSD
kernels can execute on bare metal, but it can nonetheless still be useful; in
particular, the BSD bootloaders can be executed from SeaBIOS.
2022-01-03 22:29:31 +00:00
This is provided as a coreboot payload, either as first payload or it can be
executed from GRUB (if GRUB is the main payload, on a given target).
2022-01-03 22:29:31 +00:00
src/u-boot/
---------------
2023-04-10 04:56:52 +00:00
Please also visit: <https://www.denx.de/project/u-boot/>
This is a bootloader provided on ARM chromebooks, within Libreboot. It also
provides UEFI. Information about that can be found on these resources:
* [U-Boot documentation](../u-boot/)
* [Chromebook documentation](../install/chromebooks.md)
This is currently the only payload on *ARM* systems, within Libreboot.
src/uefitool/
---------------
Please also visit: <https://github.com/LongSoft/UEFITool>
This is compiled, so as to provide `UEFIExtract`. Currently used by the
vendor download script at `script/vendor/download`, to download SCH5545 EC
firmware (used for fan control on Dell Precision T1650).
src/pico-serprog
---------------------------
Used by lbmk, to build firmware for serprog-based SPI flashers with RP2040 SoC.
Alongside this, `util-fw/rp2040/pico-sdk` is imported which is required for
building it.
Please visit these pages:
* <https://github.com/raspberrypi/pico-sdk>
* <https://codeberg.org/libreboot/pico-serprog>
src/stm32-vserprog
----------------------
Used by lbmk, to build firmware for serprog-based SPI flashers with STM32 MCU.
Alongside this, `libopencm3` is imported which is required for building it.
* <https://codeberg.org/libreboot/stm32-vserprog>
* <https://github.com/libopencm3/libopencm3>
2022-01-03 22:29:31 +00:00
These serprog programmers are quite desirable, owing to their low cost and ease
of use. You can learn more on the [SPI flashing guide](../install/spi.md).
2022-01-03 22:29:31 +00:00
Before moving onto configurations, we will now cover *utilities* provided by
Libreboot itself (included within lbmk, rather than being downloaded like the
third party projects listed above):
2022-01-03 22:29:31 +00:00
tmp/
---------------
The `TMPDIR` environmental variable is set by lbmk, to a location under `/tmp`,
but some users may have `/tmp` mounted as a *tmpfs* (file system in RAM), and
may not have much RAM.
Where large files (or a large number of files) are handled by lbmk on a
temporary basis, this `tmp/` directory is created and then used.
vendor/
---------------
Used by the vendor file handler scripts, referenced in certain coreboot configs.
Certain vendor files such as Intel ME or SCH5545 EC firmware are downloaded
here; not all such files are downloaded here however, as some are handled under
separate directories.
util/
===============
If a codebase is not frequently used by Libreboot, is actively developed (making
it not viable to maintain in Libreboot) or the codebase is very large, we would
import that as a third party module in lbmk - this rule exists for all projects,
where the intention is that `lbmk.git` itself should be small and efficient.
2023-04-10 04:56:52 +00:00
Where appropriate, and where the code is small enough, or it is otherwise deemed
desirable, `lbmk.git` provides a few utilities as part of itself, namely:
2023-04-10 04:56:52 +00:00
util/dell-flash-unlock/
---------------
**NOTE (15 October 2023): The util is now called `dell-flash-unlock`, but it
was previously called `e6400-flash-unlock`. Links have been updated.**
This program, written by Nicholas Chin, unlocks the boot flash on Dell Latitude
E6400; it permits internal flashing, from factory firmware to Libreboot, so that
the user need not disassemble and flash externally.
It also supports several other Dell laptops, with similar ECs. Check the
README file included in this directory, for more information.
util/me7\_update\_parser/
---------------
2023-04-10 04:56:52 +00:00
This is a special fork of `me_cleaner`, specifically for parsing and neutering
Intel ME images provided by Lenovo for ThinkPad X220 and other Lenovo
ThinkPads of Intel SandyBridge platform. You can find information about this
on the original repository:
<https://github.com/Thrilleratplay/me7_update_parser>
ME7 Update Parser was originally written for *Heads*, another coreboot distro
very similar to Libreboot that provides coreboot build automation with Linux
based payload configurations. *Their* build system auto-downloads and
auto-neuters Intel ME images, during build, so that the user does not have to
manually extract such images from dumps of the original vendor firmware (in
the flash) on a given machine.
Such logic was ported to Libreboot, courtesy of `shmalebx9` as mentioned
on the [who page](../../who.md) - Caleb is a core developer in the Libreboot
project.
util/nvmutil/
---------------
The `nvmutil` software allows you to set the MAC address on Intel GbE NVM
files. It also allows you to set *random* MAC addresses, in addition to
arbitrary ones.
This directory contains the source code for `nvmutil`, which you can read
about here:
[nvmutil manual](../install/nvmutil.md)
util/spkmodem\_recv/
---------------
FSF has original copyright on this; it was imported from coreboot, who in turn
imported it from GRUB with very little modification. Therefore, this code is
canonically based on what is provided in GNU GRUB.
This is a receiving client for spkmodem, which is a method of providing serial
consoles via pulses on the PC speaker. The `spkmodem_recv` client will *decode*
these pulses. Coreboot has a driver for generating these pulses, as does
GRUB; this client code was imported from GRUB, and has in fact been provided
by every Libreboot release since the start of the project (look inside the GRUB
or coreboot source code and you'll find it).
However, the original code from GRUB was of quite poor quality and this code
is often used. For fun, it was decided that this utility would be imported
directly into `lbmk.git`, and thoroughly cleaned. The lbmk version has been
more or less re-written, using the original logic as a base; variables are
more clearly named. A top-down, OpenBSD-inspired coding style is used,
replacing the GNU coding style implemented in the original code. The [OpenBSD
coding style][https://man.openbsd.org/style.9] is much easier to read.
This code has been modified to make use of the `pledge()` system call, when used
on [OpenBSD](https://www.openbsd.org/); the original version from GRUB did not
do this. Other improvemnts include:
* Superior error handling (the program actually exits with non-zero status now,
under fault conditions, whereas the original code did *not* handle errors).
* Debug mode is now handled via `getopt()` by passing the `-d` flag at run time,
whereas the original code only enabled it if a DEBUG build-time flag was used.
* The code has been translated into English (e.g. references to "trames" in
the code, now say "frames" in the Libreboot version).
* Certain magic numbers, and certain equations in code, are now labelled as
either variables or as `#define` values, thus increasing code legibility.
*Now* in the next sections, you will learn about configuration files provided
by lbmk:
config/
=======
This directory contains configuration files, used by the Libreboot build
system. These next sections will cover specific configuration files.
config/vendor/
---------------
### config/vendor/sources
2023-04-10 04:56:52 +00:00
URLs and hashes for vendor files containing Intel ME images within them. Where
feasible, backup URLs are also provided. SHA512 checksums are defined, so that
2023-04-10 04:56:52 +00:00
lbmk can verify the integrity of downloaded files.
When building for sandybridge, ivybridge and haswell machines, Libreboot's
build system automatically downloads such updates from the vendor, to extract
2023-04-10 04:56:52 +00:00
the Intel ME image and neuter it with `me_cleaner` or `me7_update_parser.py`.
Of course, backing up the original firmware is still a good idea, before
installing Libreboot or any other spin of coreboot.
This file is also used to define the VGA ROM, on Nvidia models of Dell Latitude
E6400.
2022-01-03 22:29:31 +00:00
config/coreboot
---------------
2022-01-03 22:29:31 +00:00
### config/coreboot/build.list
2022-01-03 22:29:31 +00:00
When a given coreboot tree is compiled, for a given target, this file defines
which files to copy from the coreboot directory, which are then copied to
a location under `elf/coreboot`.
2022-01-03 22:29:31 +00:00
The presence of this file affects behaviour in `script/update/release`;
specifically, PROJECT is then downloaded to `src/PROJECT/PROJECT`, and files
under `config/PROJECT/TARGET/target.cfg` define which tree to use, which then
looks under `config/PROJECT/TREE/target.cfg` to get the git revision; then
the src directory `src/PROJECT/TREE` is created, copied
from `src/PROJECT/PROJECT`.
For example, coreboot target `x200_8mb` refers to tree name `default` which
would create `src/coreboot/default`.
If the `build.list` file is *not* included, then the git revision
under `config/git` is used, and only `src/PROJECT` is created.
### config/coreboot/BOARDNAME/
Each target name (e.g. `x200_8mb`) has its own directory under here. Targets
that do not define defconfigs also exist here; for example, the `default`
directory defines a coreboot revision and patches.
Targets under `config/coreboot` can specify `tree=TREE` where `TREE` could,
for example, be `default`. In other words, they can refer to other trees.
2022-01-03 22:29:31 +00:00
The coreboot downloads are based on scanning of these directories, and ROM
images are also built based on them; coreboot defconfigs are also used by
the vendor scripts, for adding or removing certain vendor firmware (for example,
a config will define where `me.bin` is located, and if it doesn't exist, the
vendor scripts will look up that file and download/process it with `me_cleaner`).
### config/coreboot/BOARDNAME/patches/
For any given coreboot tree, patches with the `patch` file extension are placed
here, alphanumerically in the order that they should be applied.
These patches are then so applied, when lbmk downloads the given source tree.
### config/coreboot/BOARDNAME/target.cfg
2022-01-03 22:29:31 +00:00
This file can contain several configuration lines, each being a string, such
as:
* `tree="default"` (example entry)
2022-01-03 22:29:31 +00:00
* `romtype="normal"` (example entry)
* `rev="ad983eeec76ecdb2aff4fb47baeee95ade012225"` (example entry)
2022-01-03 22:29:31 +00:00
* `arch="x86_64"` (example entry)
* `payload_grub="y"` (example entry)
* `payload_grub_withseabios="y"` (example entry)
* `payload_seabios="y"` (example entry)
* `payload_memtest="y"` (example entry)
* `payload_uboot="y"` (example entry)
2022-01-03 22:29:31 +00:00
* `payload_seabios_withgrub="y"` (example entry)
* `grub_scan_disk="ata"`
* `uboot_config=default` (specify which U-Boot tree to use)
* `vendorfiles="n"`
* `microcode_required="y"`
2022-01-03 22:29:31 +00:00
The `tree` value refers to `config/coreboot/TREE`; in other words, a given
target could specify a name other than its own as the tree; it would then
re-use code from that tree, rather than providing its own.
2022-01-03 22:29:31 +00:00
The `romtype` entry is used during the building of ROM images, to define
special steps; for example, d8d16sas` would tell lbmk that a fake PIKE2008
ROM must be inserted into CBFS (prevents hanging on SeaBIOS).
2022-01-03 22:29:31 +00:00
The `rev` entry defines which coreboot revision to use, from the
coreboot Git repository. *At present, lbmk only supports use of the official
2022-01-03 22:29:31 +00:00
repository from the upstream coreboot project*.
The `arch` entry specifies which CPU architecture is to be used: currently
recognized entries are `x86_32`, `x86_64`, `ARMv7` and `AArch64`. *Setting it
to a non-native arch means that necessary crossgcc-arch will be compiled and be
available when building roms, but not necessarily built or discovered when
individual scripts are called manually.*
2022-01-03 22:29:31 +00:00
2023-04-09 21:38:30 +00:00
The `payload_grub` entry specifies whether or not GRUB is to be included in
2022-01-03 22:29:31 +00:00
ROM images.
The `payload_grub_withseabios` entry specifies whether or not SeaBIOS is to
be included *with* GRUB, in ROM images. Turning this on also turns
on `payload_seabios_withgrub`, unless that option is explicitly turned off.
The `payload_seabios` entry specifies whether or not SeaBIOS is to be included
in ROM images. This option is *automatically* enabled
if `payload_grub_withseabios` and/or `payload_seabios_withgrub` are also turned
on.
The `payload_memtest` entry specifies whether or not MemTest86+ is to be
included in ROM images; it will only be included in ROM images for *text mode*
startup, on x86 machines.
The `payload_uboot` entry specifies whether or not U-Boot is to be included in
ROM images.
The `uboot_config` option specifies which U-Boot board configuration file
variant should be used. It currently doesn't make sense for this to be anything
other than `default`, which is the default if the option is missing.
2022-01-03 22:29:31 +00:00
The `grub_scan_disk` option specifies can be `ahci`, `ata` or `both`, and it
determines which types of disks are to be scanned, when the `grub.cfg` file in
GRUB payloads tries to automatically find other `grub.cfg` files supplied by
2023-04-09 21:38:30 +00:00
your Linux distribution. On some machines, setting it to `ata` or `ahci`
2022-01-03 22:29:31 +00:00
can improve boot speed by reducing delays; for example, trying to scan `ata0`
on a ThinkPad X60 with the optical drive may cause GRUB to hang, so on that
machine it is advisable to set this option to `ahci` (becuse the default HDD
slot is AHCI).
The `vendorfiles` entry doesn't affect anything in code, except that
the `noblobs` string will be appended to ROM image file names, on releases;
ditto `nomicrocode` but in that case, the behaviour is: if no microcode to
begin with, only `nomicrocode` images will be named, otherwise ROM images with
and without microcode updates will be provided in releases (CPU microcode
updates).
### config/coreboot/BOARDNAME/config/
2022-01-03 22:29:31 +00:00
Files in this directory are *coreboot* configuration files.
Configuration file names can be as follows:
* `libgfxinit_corebootfb`
* `libgfxinit_txtmode`
* `vgarom_vesafb`
* `vgarom_txtmode`
* `normal`
Information pertaining to this can be found on
the [installation manual](../install/)
In `lbmk`, a board-specific directory under `config/coreboot/` should never
2022-01-03 22:29:31 +00:00
specify a coreboot revision. Rather, a directory *without* coreboot configs
should be created, specifying a coreboot revision. For example, the
directory `config/coreboot/default/` specifies a coreboot revision. In the
2022-01-03 22:29:31 +00:00
board-specific directory, your `board.cfg` could then
specify `cbtree="default"` but without specifying a coreboot revision (this
is specified by `config/coreboot/default/board.cfg`).
2022-01-03 22:29:31 +00:00
When you create a coreboot configuration, you should set the payload to *none*
because `lbmk` itself will assume that is the case, and insert payloads itself.
2022-01-03 22:29:31 +00:00
Configurations with `libgfxinit` will use coreboot's native graphics init code
if available on that board. If the file name has `txtmode` in it, coreboot
will be configured to start in *text mode*, when setting up the display. If
the file name has `corebootfb` in it, coreboot will be configured to set up a
high resolution *frame buffer*, when initializing the display.
NOTE: If the configuration file is `libgfxinit_txtmode`, the SeaBIOS payload
can still run *external* VGA option ROMs on graphics cards, and this is the
recommended setup (SeaBIOS in text mode) if you have a board with both onboard
and an add-on graphics card (e.g. PCI express slot) installed.
Configuration files with `vgarom` in the name have coreboot itself configured
to run VGA option ROMs (and perhaps other option ROMs). *This* setup is not
strictly recommended for *SeaBIOS*, and it is recommended that you only run
GRUB in this setup. As such, if you wish for a board to have coreboot initialize
the VGA ROM (on an add-on graphics card, as opposed to onboard chipset), you
should have a *separate* directory just for that, under `config/coreboot/`;
2022-01-03 22:29:31 +00:00
another directory for that board will have configs with `libgfxinit`. HOWEVER:
It *is* supported in lbmk to have SeaBIOS used, on either setup. In the
directory `config/seabios/` there are SeaBIOS configs for both; the vgarom
2022-01-03 22:29:31 +00:00
one sets VGA hardware type to *none* while the libgfxinit one sets it
to *coreboot linear framebuffer*. However, if you use SeaBIOS on a setup with
coreboot also doing option ROM initialization, such initialization is being
performed *twice*. As such, if you want to use an add-on graphics card in
SeaBIOS, but the board has libgfxinit, it is recommended that you do it from
a `libgfxinit` ROM.
HOWEVER: there's no hard and fast rule. For example, you could make a vgarom
configuration, on a board in lbmk, but in its coreboot configuration, don't
2022-01-03 22:29:31 +00:00
enable native init *or* oproms, and do SeaBIOS-only on that board.
On `vgarom` setups, coreboot can be configured to start with a high resolution
VESA frame buffer (NOT to be confused with the coreboot frame buffer), or just
normal text mode. Text mode startup is always recommended, and in that setup,
GRUB (including coreboot GRUB, but also PC GRUB) can use VGA modes.
The name `libgfxinit` is simply what `./build roms` uses, but it may be
2022-01-03 22:29:31 +00:00
that a board uses the old-school native video init code written in C. On some
platforms, coreboot implemented a 3rd party library called `libgfxinit`, which
is written in Ada and handles video initialization. In this setup, coreboot
*itself* should *never* be configured to run any option ROMs, whether you
start in text mode or with the coreboot framebuffer initialization.
The `normal` config type is for desktop boards that lack onboard graphics
chipsets, where you would always use an add-on graphics card (or *no* graphics
card, which would be perfectly OK on servers).
Even if your board doesn't actually use `libgfxinit`, the config for it should
still be named as such. From a user's perspective, it really makes no
difference.
config/dependencies/
---------------
2022-01-03 22:29:31 +00:00
Files here are so named, and called like so: e.g. the `debian` file would be
referenced when running:
2022-01-03 22:29:31 +00:00
./build dependencies debian
2022-01-03 22:29:31 +00:00
These files define a list of packages, and the correct package manager command
to use on a given distro. This can be used to install build dependencies, which
are required for compiling Libreboot from source code.
2022-01-03 22:29:31 +00:00
config/git/
---------------
2022-01-03 22:29:31 +00:00
Configuration related to third-party Git repositories, that Libreboot makes
use of.
2022-01-03 22:29:31 +00:00
These file define third party codebases, with repository links, revision IDs,
and dependencies (referring to other modules defined in this file).
2022-01-03 22:29:31 +00:00
Almost every third party codebase that lbmk downloads is based on the handling
of *this* file. Some of the codebases defined here will also have a directory
of their own; for example, `config/grub/` exists.
2022-01-03 22:29:31 +00:00
Multiple files exist here, and they are *concatenated* in a temporary file by
lbmk, which is then scanned to find information about projects.
config/grub/
---------------
2022-01-03 22:29:31 +00:00
### config/grub/background
2022-01-03 22:29:31 +00:00
Splash screen images applied duing startup when using the GRUB payload.
2022-01-03 22:29:31 +00:00
### config/grub/background/background1024x768.png
2022-01-03 22:29:31 +00:00
Used on ThinkPad X60 and T60.
### config/grub/background/background1280x800.png
Used on all other machines, besides X60 and T60 thinkpads.
NOTE: the `grub_background` option can be set under `target.cfg` in the
relevant coreboot directory, under `config/coreboot/`; for
example, `config/coreboot/x60/target.cfg` specifies this:
2022-01-03 22:29:31 +00:00
grub_background="background1024x768.png"
2022-01-03 22:29:31 +00:00
### config/grub/background/COPYING
2022-01-03 22:29:31 +00:00
Licensing info for GRUB bootsplash images.
2022-01-03 22:29:31 +00:00
### config/grub/config/
2022-01-03 22:29:31 +00:00
GRUB configuration files.
2022-01-03 22:29:31 +00:00
### config/grub/config/AUTHORS
2022-01-03 22:29:31 +00:00
Author info for GRUB configuration files.
2022-01-03 22:29:31 +00:00
### config/grub/config/COPYING
2022-01-03 22:29:31 +00:00
Licensing info for GRUB configuration files.
2022-01-03 22:29:31 +00:00
### config/grub/config/grub.cfg
2022-01-03 22:29:31 +00:00
This is a configuration file. It is used to program GRUB's shell.
2022-01-03 22:29:31 +00:00
This is inserted (as `grub.cfg`) into the GRUB memdisk, in the ROM image. It
contains a lot of logic in it, for booting various system configurations, when
the GRUB payload is in use.
2022-01-03 22:29:31 +00:00
It can be overridden by inserting `grub.cfg` into coreboot's main CBFS root.
2022-01-03 22:29:31 +00:00
A `grubtest.cfg` can be inserted into CBFS, but it will not override the
default `grub.cfg` (either in CBFS or on memdisk); however, the one in memdisk
will provide a menuentry for switching to this, if available.
2022-01-03 22:29:31 +00:00
### config/grub/config/grub\_memdisk.cfg
2022-01-03 22:29:31 +00:00
This GRUB configuration checks whether `grub.cfg` exists in CBFS and switches
to that first (not provided by default) or, if one is not available in CBFS,
it will load the `grub.cfg` stored inside GRUB memdisk.
2023-04-10 04:56:52 +00:00
The GRUB memdisk is a file system within `grub.elf`, itself stored within the
coreboot file system named *CBFS*, which is part of the coreboot ROM image on
every coreboot target.
2023-04-10 04:56:52 +00:00
### config/grub/keymap/
2022-01-03 22:29:31 +00:00
Keymap files used by GRUB. They can alter the character set corresponding to
inputted scancodes.
2023-04-10 04:56:52 +00:00
### config/grub/keymap/\*.gkb
2023-04-10 04:56:52 +00:00
The keymap files themselves. These are inserted into the GRUB memdisk, and
the `grub.cfg` file can specify which one is to be used.
2023-04-10 04:56:52 +00:00
These files are binary-encoded, defining which characters correspond to which
scancodes. It is handled by `grub-core/commands/keylayouts.c` in the GRUB source
code.
2023-04-10 04:56:52 +00:00
### config/grub/modules.list
2023-04-10 04:56:52 +00:00
This defines which modules are inserted into `grub.elf`. These modules can be
anything from file systems, small applications/utilities, launchers (e.g.
the `linux` command will execute a Linux kernel), you name it.
2023-04-10 04:56:52 +00:00
Libreboot defines only a very conservative set of modules here, so as to reduce
the amount of space used in the main boot flash. (GRUB payloads are also
compressed when they are inserted into coreboot images)
This list is used by lbmk when it runs `grub-mkstandalone`, which is the utility
from GRUB that generates `grub.elf` files (to be compressed inside CBFS and then
executed as a coreboot payload).
### config/grub/patches/
2023-04-10 04:56:52 +00:00
For a given GRUB revision, patches with the `patch` file extension are placed
here, alphanumerically in the order that they should be applied. For example,
Libreboot provides argon2 key derivation support out of tree, allowing LUKS2
partitions to be decrypted by GRUB.
2023-04-10 04:56:52 +00:00
These patches are then so applied, when lbmk downloads the given source tree.
2023-04-10 04:56:52 +00:00
config/ifd/\*
---------------
Intel Flash Descriptors and GbE NVM images, which are binary-encoded
configuration files. These files are referenced in coreboot defconfigs, used
by lbmk to build coreboot ROM images.
config/seabios/
---------------
### config/seabios/build.list
When a given SeaBIOS tree is compiled, for a given target, this file defines
which files to copy from the `seabios/` directory, which are then copied to
a location under `elf/seabios`.
### config/seabios/default/
2023-04-10 04:56:52 +00:00
Currently the only tree in use, this defines what SeaBIOS revision is to be
used, when the SeaBIOS payload is enabled on a given coreboot target.
2023-04-10 04:56:52 +00:00
### config/seabios/default/config/
Configuration files go in here.
### config/seabios/default/config/libgfxinit
2023-04-10 04:56:52 +00:00
Configuration file for when native video initialisation is available in
coreboot.
2023-04-10 04:56:52 +00:00
### config/seabios/default/config/normal
2023-04-10 04:56:52 +00:00
Configuration file for when native video initialisation is unavailable in
coreboot, and VGA ROM initialisation is also not provided by coreboot (in
this configuration, the usual setup will be that *SeaBIOS* finds and
executes them, instead of coreboot).
2022-01-03 22:29:31 +00:00
### config/seabios/default/config/vgarom
2022-01-03 22:29:31 +00:00
Configuration file for when native video initialisation is unavailable in
coreboot, and VGA ROM initialisation is provided by coreboot; in this setup,
SeaBIOS should not execute VGA ROMs.
2022-01-03 22:29:31 +00:00
### config/seabios/default/target.cfg
2022-01-03 22:29:31 +00:00
Similar concept to `target.cfg` files provided by coreboot. This specifies
which SeaBIOS revision (from Git) is to be used, when compiling SeaBIOS images.
2022-01-03 22:29:31 +00:00
config/u-boot/
---------------
2022-01-03 22:29:31 +00:00
This directory contains configuration, patches and so on, for each mainboard
that can use U-Boot as a payload in the `lbmk` build system. U-Boot doesn't yet
have reliable generic configurations that can work across all coreboot boards
(per-architecture), so these are used to build it per-board.
2022-01-03 22:29:31 +00:00
### config/u-boot/build.list
2022-01-03 22:29:31 +00:00
When a given U-Boot tree is compiled, for a given target, this file defines
which files to copy from the U-Boot source build, which are then copied to
a location under `elf/u-boot/`.
2023-04-10 04:56:52 +00:00
### config/u-boot/TREENAME/
2023-04-10 04:56:52 +00:00
Each `TREENAME` directory defines configuration for a corresponding mainboard.
It doesn't actually have to be for a board; it can also be used to just define
a U-Boot revision, with patches and so on. To enable use as a payload in ROM
images, this must have the same name as its `config/coreboot/TREENAME/`
counterpart.
2022-01-03 22:29:31 +00:00
### config/u-boot/TREENAME/patches/
2022-01-03 22:29:31 +00:00
For any given U-Boot tree, patches with the `patch` file extension are placed
here, alphanumerically in the order that they should be applied.
2022-01-03 22:29:31 +00:00
These patches are then so applied, when lbmk downloads the given source tree.
2022-01-03 22:29:31 +00:00
### config/u-boot/TREENAME/target.cfg
2022-01-03 22:29:31 +00:00
This file can contain several configuration lines, each being a string, such
as:
2022-01-03 22:29:31 +00:00
* `tree="default"` (example entry)
* `rev="4debc57a3da6c3f4d3f89a637e99206f4cea0a96"` (example entry)
* `arch="AArch64"` (example entry)
2022-01-03 22:29:31 +00:00
These are similar in meaning to their coreboot counterparts.
2022-01-03 22:29:31 +00:00
The tree` entry is actually a link, where its value is a directory name
under `config/u-boot`. For example, `tree="default"` would refer to
`config/u-boot/default` and the corresponding U-Boot source tree created
(when running `./update trees u-boot`, which makes use of `target.cfg`)
would be `u-boot/default/`. In other words: a `target.cfg` file
in `config/u-boot/foo` might refer to `config/u-boot/bar` by
specifying `tree="bar"`, and the created u-boot source tree would
be `u-boot/bar/`. ALSO:
2022-01-03 22:29:31 +00:00
FUN FACT: such references are infinitely checked until resolved. For
example, `foo` can refer to `bar` and `bar` can refer to `baz` but if there is
an infinite loop, this is detected and handled by lbmk. For example,
if `bar` refers to `foo` which refers back to `bar`, this is not permitted
and will throw an error in lbmk.
2022-01-03 22:29:31 +00:00
The `rev` entry defines which U-Boot revision to use, from the U-Boot
Git repository. *At present, lbmk only supports use of the official repository
from the upstream U-Boot project*.
2022-01-03 22:29:31 +00:00
The `arch` entry specifies which CPU architecture is to be used: currently
recognized entries are `x86_32`, `x86_64`, `ARMv7` and `AArch64`. *Setting it
to a non-native arch means that necessary crossgcc-arch will be compiled and be
available when building roms, but not necessarily built or discovered when
individual scripts are called manually.*
2022-01-03 22:29:31 +00:00
### config/u-boot/TREENAME/config/
2023-04-10 04:56:52 +00:00
Files in this directory are *U-Boot* configuration files. Configuration file
names can be anything, but for now `default` is the only one used.
2022-01-03 22:29:31 +00:00
In lbmk, a board-specific directory under `config/u-boot/` should never
specify a U-Boot revision. Rather, a directory *without* U-Boot configs should
be created, specifying a U-Boot revision. For example, the directory
`config/u-boot/default/` specifies a U-Boot revision. In the board-specific
directory, your `board.cfg` could then specify `ubtree="default"` but without
specifying a U-Boot revision (this is specified by
`config/u-boot/default/board.cfg`).
2022-01-03 22:29:31 +00:00
Normally, the U-Boot build process results in the U-Boot executable and a
device-tree file for the target board, which must further be packaged together
to make things work. When you create a U-Boot configuration, you should enable
`CONFIG_REMAKE_ELF` or `CONFIG_OF_EMBED` that handles this. The former option
enables creation of a `u-boot.elf` that bundles them together after the build,
and the latter option embeds it into the `u-boot` executable.
2022-01-03 22:29:31 +00:00
When making a U-Boot configuration, you should also pay special attention to
the `CONFIG_SYS_TEXT_BASE` (`CONFIG_TEXT_BASE` in later versions), whose defaults
may cause it to overlap coreboot, in which case it won't boot. Normally, the
upstream coreboot build system checks for this when given `CONFIG_PAYLOAD_ELF`,
but `lbmk` injects the payload itself and doesn't check for this yet.
2022-01-03 22:29:31 +00:00
Another interesting config option is `CONFIG_POSITION_INDEPENDENT` for ARM
boards, which has been so far enabled in the ones `lbmk` supports, just to be
safe.
2022-01-03 22:29:31 +00:00
U-Boot build system
-------------------
2022-01-03 22:29:31 +00:00
If you wish to know about U-Boot, refer here:\
<https://u-boot.readthedocs.io/en/latest/>
2022-01-03 22:29:31 +00:00
This and other documents from U-Boot shall help you to understand *U-Boot*.
2022-01-03 22:29:31 +00:00
You create a config, for `config/u-boot/TREENAME/configs`, by finding the
corresponding board name in the upstream U-Boot `configs` directory, and
running `make BOARDNAME_defconfig` and `make menuconfig` commands in the
*U-Boot* build system. You should do this after
running `./update trees u-boot` in lbmk.
2022-01-03 22:29:31 +00:00
You might want to consider basing your config on the upstream `coreboot` boards
when possible, but such a board is not available upstream for ARM yet.
2022-01-03 22:29:31 +00:00
You can simply clone U-Boot upstream, add whatever patches you want, and
then you can make your config. It will appear afterwards in a file
named `.config` which is your config for inside `config/u-boot/TREENAME/`.
2022-01-03 22:29:31 +00:00
You can then use `git format-patch -nX` where `X` is however many patches you
added to that U-Boot tree. You can put them in the patches directory
under `config/u-boot/BOARDNAME`.
2022-01-03 22:29:31 +00:00
The *base* revision, upon which any custom patches you wrote are applied,
shall be the `rev` entry.
2022-01-03 22:29:31 +00:00
Scripts exist in lbmk for automating the modification/updating of *existing*
configs, but not for adding them. Adding them is to be done manually, based on
the above guidance.
2022-01-03 22:29:31 +00:00
Config files in lbmk root directory
===================================
2022-01-03 22:29:31 +00:00
projectname
---------------
2022-01-03 22:29:31 +00:00
This is a text file, containing a single line that says `libreboot`. This string
is used by the build system, when naming releases alongside the version number.
2022-01-03 22:29:31 +00:00
version
---------------
2022-01-03 22:29:31 +00:00
Updated each time lbmk runs, based on either `git describe` or, on release
archives, this file is static and never changes. It says what Libreboot revision
is currently in use (or was in use, if lbmk isn't running).
2022-01-03 22:29:31 +00:00
versiondate
---------------
2022-01-03 22:29:31 +00:00
Updated each time lbmk runs, based on either `git describe` or, on release
archives, this file is static and never changes. It says the *time* of
whichever Libreboot revision is currently in use (time of commit).
2022-01-03 22:29:31 +00:00
At least, you will now learn about the *scripts* (exclusively written as
posix shell scripts) that constitute the entire Libreboot build system, lbmk:
2022-01-03 22:29:31 +00:00
Scripts in root directory of lbmk
=================================
2022-01-03 22:29:31 +00:00
build
---------------
This is the main script in lbmk, Libreboot's build system. It is what executes
all other parts of the Libreboot build system. The rules are as follows:
* Argument zero, representing the name of the symlink, will be used to
execute `script/LINKNAME/mode/option` - for example: `./build roms all`
would execute `script/build/roms all` in `sh`.
* `TMPDIR` is exclicitly set, providing a constant location where temporary
files and directories can be made. `TMPDIR` is exported by the parent to
all children; for example, `./build roms all` would export it
to `script/build/roms`, and then anything called by *that* will also
inherit it - the main parent process running `lbmk` will then clean up this
`TMPDIR` directory upon any exit.
* All exits from lbmk are handled by this script. *All* exits, zero or non-zero,
are engineered such that *this* script, in the parent process (the very first
instance) is what ultimately exits back to the user's shell prompt.
* This script is programmed to *exit* with non-zero status, when run as root,
unless the `./build dependencies *` commands are used,
referencing files under `config/dependencies/`
* Under fault conditions, each child process shall output to stderr, and the
main parent process running `lbmk` will output the final error message.
tl;dr break this script and you *break Libreboot*.
2022-01-03 22:29:31 +00:00
update
---------------
2022-01-03 22:29:31 +00:00
Symbolic link, pointing to the `build` script. This is executed by the user, or
by lbmk, referencing scripts under `script/update/*/`.
2022-01-03 22:29:31 +00:00
include/
===============
2022-01-03 22:29:31 +00:00
This directory contains *helper scripts*, to be included
by main scripts using the `.` command (called the `source`
command in `bash`, but we rely upon posix `sh` only).
2022-01-03 22:29:31 +00:00
include/err.sh
---------------
2022-01-03 22:29:31 +00:00
Generic error handling, used by all lbmk scripts.
This also contains functions to verify the current libreboot version, and check
whether Git is properly initialised on the host system. It also contains
the `setvars` function, which provides a shorthand way of initialising many
variables (combined with use of `eval`), which lbmk uses heavily.
This function also contains `x_` and `xx_` which lbmk uses to execute commands
and ensure that they cause an exit (with non-zero status) from lbmk, if they
return an error state; the `xx_` function calls `fail()` which a script must
provide, to perform some action before calling `err` which in turn prints an
error message provided as argument. It is used similarly to the C
function `err()` in BSD libc. The `x_` function simply calls `err`.
This entire file is heavily inspired by `err.h` in BSD libc code. This file is
heavily used by lbmk (it's used by every script), to provide clean error
handling in `sh`.
include/git.sh
--------------
These functions in here previously existed as independent scripts, but they
were unified here, and they are used when you pass the `-f` argument
to `script/update/trees` (e.g. `./update trees -f coreboot`).
These functions deal with git cloning, submodule updates, revision resets and
the application of patch files via `git am`. *Every* git repository downloaded
by lbmk is handled by the functions in this file.
include/mrc.sh
--------------
This was previously a separate script. The download logic was removed, and
now the logic under `include/vendor.sh` is used for downloads. This file now
only contains those functions used for extraction of MRC files from Google
Chromebook images, currently only used for Haswell mainboards.
2022-01-03 22:29:31 +00:00
This is an include, used by `script/vendor/download`, but it's here in
this file because the vendor download script is GPLv3-only, while the MRC
extract logic in this file is GPLv2-only (forked from coreboot ages ago). Thus,
it is provided as an include to bypass license incompatibility. It has been
heavily modified to use the same style of logic and general control flow used
in the script at `script/vendor/download`, and it is used from there.
include/option.sh
---------------
Functions used by scripts under `script/update/vendor/`, for checking defconfig
files. These files are checked because the scripts need to know whether a given
file is used; if it is, a path is then specified in defconfig, telling the vendor
script either where it is, or where it should be downloaded to.
Several other parts of lbmk also use this file. It is added to as little as
possible, and contains miscallaneous functions that don't belong anywhere else.
The functions here are mostly those that deal with configuration files; scanning
them to set variables and so on.
2022-01-03 22:29:31 +00:00
script/
=======
2022-01-03 22:29:31 +00:00
*All* scripts under `script/` are executed only by the main `lbmk` script,
conforming to the standard `buildpath/mode/option` e.g. `build/roms` - so,
running `./build roms` would run `script/build/roms`.
2022-01-03 22:29:31 +00:00
script/build/
---------------
2022-01-03 22:29:31 +00:00
These are highly specialised build scripts, written for specific tasks, almost
entirely in the context of building firmware images themselves, but some utils
are also handled.
2022-01-03 22:29:31 +00:00
The scripts that create release archives are also located under this directory.
2022-01-03 22:29:31 +00:00
### script/build/roms
2022-01-03 22:29:31 +00:00
This builds coreboot ROM images.
2022-01-03 22:29:31 +00:00
Command: `./build roms targetname`
2022-01-03 22:29:31 +00:00
The `targetname` argument must be specified, chosen from this output:
2022-01-03 22:29:31 +00:00
./build roms list
2022-01-03 22:29:31 +00:00
Pass several board names if you wish to build only for specific targets. For
example:
2022-01-03 22:29:31 +00:00
./build roms x60 x200_8mb
2022-01-03 22:29:31 +00:00
To build *all* targets, specify:
2022-01-03 22:29:31 +00:00
./build roms all
2022-01-03 22:29:31 +00:00
Since November 2022, this script can build images for x86 *and* ARM targets.
The *ARM* targets are ChromeOS devices (chromebooks and such); Libreboot uses
the *U-Boot* payload, rather than Google's *depthcharge* bootloader. In this
setup, U-Boot is running on the bare metal, as enabled by *coreboot*.
2022-01-03 22:29:31 +00:00
For x86 targets, these scripts build with the GRUB and/or SeaBIOS payloads
inserted into the ROM images; secondary payloads like Memtest86+ are also
handled and inserted here.
2022-01-03 22:29:31 +00:00
It heavily makes use of the `target.cfg` file, for a given board. This script
will *only* operate on a single target, from a directory in `config/coreboot/`.
2022-01-03 22:29:31 +00:00
If `grub_scan_disk` is set, it sets that in the `scan.cfg` file that is to be
inserted into a ROM image, when `payload_grub` is turned on.
2022-01-03 22:29:31 +00:00
It automatically detects if `crossgcc` is to be compiled, on a given coreboot
tree (in cases where it has not yet been compiled), and compiles it for a
target based on the `arch` entry in `target.cfg`.
2022-01-03 22:29:31 +00:00
It creates ROM images with GRUB, SeaBIOS, U-Boot, optionally with Memtest86+
also included, in various separate configurations in many different ROM images
for user installation.
2022-01-03 22:29:31 +00:00
The `romtype` entry in `target.cfg` tells this script what to do with the ROM,
after it has been built. Currently, it operates based on these possible values
for `romtype`:
2022-01-03 22:29:31 +00:00
* `d8d16sas` will cause *fake* (empty) files named `pci1000,0072.rom`
and `pci1000,3050.rom` to be inserted in CBFS. This prevents SeaBIOS from
loading or executing the option ROM stored on PIKE2008 modules, present on
certain configurations with the ASUS KCMA-D8 or KGPE-D16 mainboards. Those
option ROMs cause the system to hang, so they should never be executed (this
means however that booting Linux kernels from SAS devices is impossible on
those boards, unless a Linux payload is used; Linux can use those SAS drives,
without relying on the PIKE2008 option ROMs). When SeaBIOS runs, it will
default to loading the corresponding option ROM from CBFS, if it exists, for
a given PCI device, overriding whatever option ROM is present on the device
itself, but if the option ROM is invalid/empty, SeaBIOS will not attempt to
load another one, until the empty/invalid one (in CBFS) is deleted.
* `i945 laptop`: in this configuration, the upper 64KB section of the ROM is
copied into the 64KB section below that. This results in there being two
bootblocks in the ROM, and you can decide which one is used by setting `bucts`
* If no declaration is made, or a declaration is made contrary to the above,
no special modifications will be made.
2022-01-03 22:29:31 +00:00
If no payload is defined in `target.cfg`, the `build/roms` script will exit
with error status.
2022-01-03 22:29:31 +00:00
If SeaBIOS is to be used, on `libgfxinit` setups, SeaVGABIOS will also be
inserted. This provides a minimal VGA compatibility layer on top of the
coreboot framebuffer, but does not allow for *switching* the VGA mode. It is
currently most useful for directly executing ISOLINUX/SYSLINUX bootloaders,
and certain OS software (some Windows setups might work, poorly, depending on
the board configuration, but don't hold your breath; it is far from complete).
2022-01-03 22:29:31 +00:00
If SeaBIOS is to be used, in `vgarom` setups or `normal` setups, SeaVGABIOS
is not inserted and you rely on either coreboot and/or SeaBIOS to execute VGA
option ROMs.
2022-01-03 22:29:31 +00:00
In all cases, this script automatically inserts several SeaBIOS runtime
configurations, such as: `etc/ps2-keyboard-spinup` set to 3000 (PS/2 spinup
wait time), `etc/pci-optionrom-exec` set to 2 (despite that already being
the default anyway) to enable *all* option ROMs, unless `vgarom` setups are
used, in which case the option is set to *0* (disabled) because coreboot is
then expected to handle option ROMs, and SeaBIOS should not do it.
2022-01-03 22:29:31 +00:00
This script handles U-Boot separately, for ARM-based chromeos devices.
2022-01-03 22:29:31 +00:00
When the ROM is finished compiling, it will appear under a directory in `bin/`
2022-01-03 22:29:31 +00:00
This script is the beating heart of Libreboot. Break it, and you break
Libreboot!
2022-01-03 22:29:31 +00:00
### script/build/grub
2022-01-03 22:29:31 +00:00
This builds the `grub.elf` file and keymap configuration files, placing these
under `elf/grub/` for use by `script/build/roms`.
Command: `./build grub`
This builds the `grub-mkstandalone` utility under `src/grub/`, which is used
by `script/build/roms` to insert GRUB payloads inside coreboot ROM
images.
### script/build/serprog
Build firmware images for serprog-based SPI programmers, where they use an
STM32 MCU. It also builds for RP2040-based programmers like Raspberry Pi Pico.
2022-01-03 22:29:31 +00:00
Example command: `./build serprog stm32`
2022-01-03 22:29:31 +00:00
Example command: `./build serprog rp2040`
2022-01-03 22:29:31 +00:00
The `list` argument is available:
2022-01-03 22:29:31 +00:00
./build serprog stm32 list
2022-01-03 22:29:31 +00:00
Without arguments, all targets would be compiled, but you can specify a short
list of targets instead, based on the output of `list`.
2022-01-03 22:29:31 +00:00
script/update/
--------------
2023-04-10 04:56:52 +00:00
This handles most actual building of source trees, called into by scripts
under `script/build/fw` - it also contains logic for downloading source trees
or vendor files.
2023-04-10 04:56:52 +00:00
### script/update/release
This script builds the release archives, which are then provided in a new
Libreboot release. Most users do not need to look at this file at all, but it
is provided under free license for curious souls.
Command: `./update release`
NOTE: if the `-d` option is used, you can specify a directory other
than `release`. For example:
2022-01-03 22:29:31 +00:00
./update release -d /media/stuff/libreboot_release_test
2022-01-03 22:29:31 +00:00
If `-d` is not passed, they will go under `release/` in your lbmk repository.
The script is engineered to re-initialise git if ran from a release archive.
Libreboot releases after 20230625 include `.gitignore` in the src archive.
2022-01-03 22:29:31 +00:00
This builds release archives, containing ROM images for coreboot and/or serprog
programmers. It works simply: lbmk clones *itself*, and builds itself in its
clone, then cleans itself up and creates tarballs. If you run this script, you
should expect it to take at least 4 hours; slower on really old systems. On
really fast systems, it might take 2-3 hours.
2022-01-03 22:29:31 +00:00
NOTE: This script *scrubs* certain vendor firmware from release ROMs, such as
Intel ME or MRC firmware. The release ROMs shall then exclude these files
within them, requiring manual insertion by the user post-release. See:
2022-01-03 22:29:31 +00:00
[Insert vendor files
on Sandybridge/Ivybridge/Haswell](../install/ivy_has_common.md)
2022-01-03 22:29:31 +00:00
### script/update/trees
2022-01-03 22:29:31 +00:00
*This* is the other beating heart of Libreboot. Used heavily by Libreboot, this
script is what handles defconfig files for SeaBIOS, U-Boot *and* coreboot; it
used to be separate scripts, but the logic was unified under this single script.
2022-01-03 22:29:31 +00:00
It *also* handles simple git trees, where there is only one revision for the
project, e.g. GRUB, and the command syntax is the same. Whether a project is
multi-tree or single-tree is determined by the presence of the
file `config/PROJECT/build.list` - if it exists, it's multi-tree, otherwise
single-tree.
2022-01-03 22:29:31 +00:00
It *also*, in addition to downloading from git, can handle modification or
updating of defconfig files. As already stated, and stated further: it is
Libreboot's other beating heart. Break this, and you break Libreboot.
2022-01-03 22:29:31 +00:00
For multi-tree projects, it handles the following files (PROJECT can
be `coreboot`, `seabios` or `u-boot`):
2022-01-03 22:29:31 +00:00
* `config/PROJECT/build.list` (defines what files to copy, after building for
the target)
* `config/PROJECT/*/target.cfg` (lbmk build parameters, project project/target)
* `config/PROJECT/*/config/*` (defconfig files)
For single-tree projects, these files are used:
* `config/git/` - files are concatenated and then scanned, to find project info.
NOTE: For multi-tree projects, `config/git` is still used, to download the
upstream repository to `src/PROJECT/PROJECT` but with git revision being `HEAD`.
In this way, you always have the latest code, but revisions defined
in `config/PROJECT/TARGET/target.cfg` will define a tree,
then `config/PROJECT/TREE/target.cfg` (which could be the same as `TARGET`,
but this is not the preferred style in lbmk) will define a revision; then,
the directory `src/PROJECT/TREE` will be created, reset to the specific
revision - for multi-tree projects, all defined targets are scanned for their
corresponding tree, and the trees are prepared as defined above.
Basic command: `./update trees FLAG projectname`
Special operation: for building coreboot utilities `cbfstool` and `ifdtool` to
go under `cbutils/`, do this:
2022-01-03 22:29:31 +00:00
./update trees -b coreboot utils
2022-01-03 22:29:31 +00:00
Or define specific coreboot tree such as:
./update trees -b coreboot utils default
./update trees -b coreboot utils cros
2022-01-03 22:29:31 +00:00
FLAG values are (only *one* to be used at a time):
2022-01-03 22:29:31 +00:00
* `-b` builds an image for the target, based on defconfig for multi-tree
projects, or based only on a Makefile for single-tree projects; on some
single-tree projects, this script also handles *cmake*.
* `-u` runs `make oldconfig` on the target's corresponding source tree, using
its defconfig (useful for automatically updating configs, when updating trees
like when adding patches or switching git revisions)
* `-m` runs `make menuconfig` on the target's corresponding source tree, using
its defconfig (useful for modifying configs, e.g. changing CBFS size on
a coreboot image)
* `-c` tries `make distclean`, deferring to `make clean` under fault
conditions and from that, non-zero exit under fault conditions. This is done
on the target's corresponding source tree.
* `-x` tries 'make crossgcc-clean`. This only works on coreboot trees, but no
error status will be returned on exit if you try it on other project trees; no
action will be performed.
* `-f` downloads the Git repository for the given project, and resets to a
revision as defined under `config/git/`, or (for multi-tree projects), the
file `config/PROJECT/TREE/target.cfg` to create `src/project/treename`.
2022-01-03 22:29:31 +00:00
As for *projectname", this can either be `coreboot`, `u-boot` or `seabios`.
2022-01-03 22:29:31 +00:00
Example commands:
2022-01-03 22:29:31 +00:00
./update trees -b coreboot
./update trees -b coreboot x200_8mb
./update trees -b coreboot x230_12mb x220_8mb t1650_12mb
./update trees -x coreboot default
./update trees -u seabios
./update trees -m u-boot gru_bob
./update trees -f coreboot
./update trees -b coreboot utils default
./update trees -b coreboot utils
2022-01-03 22:29:31 +00:00
NOTE: the `-x` and `-c` options will cause an exit with zero status, when
the target's corresponding source tree is unavailable; a non-zero status is
only return under fault conditions when said source tree is *available*. ALL
other flags will cause the very same source tree to be downloaded and prepared,
if unavailable and *that* too will return with non-zero status under fault
conditions.
NOTE: "target" can indeed be the tree name, under some circumstances. For
example, `./update trees -m seabios default`
After `projectname`, a target can be specified, but if no target is specified,
then *all* targets will be operated on. For
example, `./update trees -b coreboot` will attempt to build *all*
coreboot ROM images.
NOTE: the `coreboot` projectname here shall cause the ROM images to go
under `elf/` - this is the no-payload ROM images, which are later used
separately by `script/build/roms` to provide full images, with
payloads inserted. It is an intentional design choice of Libreboot, to split
it up this way and *not* use coreboot's own build system to handle payloads.
In lbmk, there are *two* types of git download: *simple* downloads where only
a single revision would ever be used, or *multi* downloads where different
revisions are used depending on target.
All such downloads are *simple* downloads, except for coreboot, U-Boot and
SeaBIOS which are *multi* downloads. The *other* requirement is that defconfigs
be used, though this could be worked around in the future if a *multi* setup is
needed on a project that *does not use defconfigs* (this is not yet the case in
lbmk).
All of this used to about 20 different scripts, all with much-duplicated logic.
Now it is unified, efficiently, under a single script.
Remember: code equals bugs, so less code equals fewer bugs.
2022-01-03 22:29:31 +00:00
### script/vendor/download
2022-01-03 22:29:31 +00:00
This downloads vendor code when needed, on a given coreboot target. It does
this by scanning the defconfig files of that board, to know where the files
are (or where they should be) within lbmk. Based on this, it then knows which
files to download.
2022-01-03 22:29:31 +00:00
These files are then inserted at build time by the coreboot build system (as
defined by defconfigs), or post-release by running the `inject` script.
2022-01-03 22:29:31 +00:00
It looks inside `config/vendor/` at the files in there, concatenating them and
then scanning that to find info about the given board; for example, info like
where to download a Lenovo BIOS updater to extract `me.bin` from, to run through
the `me_cleaner` program.
2022-01-03 22:29:31 +00:00
More information is available [here](../install/ivy_has_common.md).
2022-01-03 22:29:31 +00:00
This script is executed automatically, when you compile ROM images, if the given
mainboard requires vendor code to be inserted. In this way, you do not need to
manually extract such files from your original vendor image.
### script/vendor/inject
2022-01-03 22:29:31 +00:00
This is not used during the build process, but it can be run by the user on
release ROMs (which do not contain non-redistributable code handled by these
vendor scripts, even if they are required). This script inserts those files
into the coreboot ROM image; if you're building from source, using lbmk, you
do not need to run the inject script at all.
2022-01-03 22:29:31 +00:00
More information is available [here](../install/ivy_has_common.md).