8.9 KiB
| title | date |
|---|---|
| using qemu-user emulation to reverse engineer binaries | 2021-05-05 |
QEMU is primarily known as the software which provides full system emulation under Linux's KVM. Also, it can be used without KVM to do full emulation of machines from the hardware level up. Finally, there is qemu-user, which allows for emulation of individual programs. That's what this blog post is about.
The main use case for qemu-user is actually not reverse-engineering, but simply running programs for one CPU architecture on another. For example, Alpine developers leverage qemu-user when they use dabuild(1) to cross-compile Alpine packages for other architectures: qemu-user is used to run the configure scripts, test suites and so on. For those purposes, qemu-user works quite well: we are even considering using it to build the entire riscv64 architecture in the 3.15 release.
However, most people don't realize that you can run a qemu-user emulator which targets the same architecture as the host. After all, that would be a little weird, right? Most also don't know that you can control the emulator using gdb, which is possible and allows you to debug binaries which detect if they are being debugged.
You don't need gdb for this to be a powerful reverse engineering tool, however. The emulator itself includes many powerful tracing features. Lets look into them by writing and compiling a sample program, that does some recursion by calculating whether a number is even or odd inefficiently:
#include <stdbool.h> #include <stdio.h>
bool isOdd(int x); bool isEven(int x);
bool isOdd(int x) { return x != 0 && isEven(x - 1); }
bool isEven(int x) { return x == 0 || isOdd(x - 1); }
int main(void) { printf("isEven(%d): %d\n", 1025, isEven(1025)); return 0; }
Compile this program with gcc, by doing gcc -ggdb3 -Os example.c -o example.
The next step is to install the qemu-user emulator for your architecture, in this case we want the qemu-x86_64 package:
$ doas apk add qemu-x86_64 (1/1) Installing qemu-x86_64 (6.0.0-r1) $
Normally, you would also want to install the qemu-openrc package and start the qemu-binfmt service to allow for the emulator to handle any program that couldn't be run natively, but that doesn't matter here as we will be running the emulator directly.
The first thing we will do is check to make sure the emulator can run our sample program at all:
$ qemu-x86_64 ./example isEven(1025): 0
Alright, all seems to be well. Before we jump into using gdb with the emulator, lets play around a bit with the tracing features. Normally when reverse engineering a program, it is common to use tracing programs like strace. These tracing programs are quite useful, but they suffer from a design flaw: they use ptrace(2) to accomplish the tracing, which can be detected by the program being traced. However, we can use qemu-user to do the tracing in a way that is transparent to the program being analyzed:
$ qemu-x86_64 -d strace ./example 22525 arch_prctl(4098,274903714632,136818691500777464,274903714112,274903132960,465) = 0 22525 set_tid_address(274903715728,274903714632,136818691500777464,274903714112,0,465) = 22525 22525 brk(NULL) = 0x0000004000005000 22525 brk(0x0000004000007000) = 0x0000004000007000 22525 mmap(0x0000004000005000,4096,PROT_NONE,MAP_PRIVATE|MAP_ANONYMOUS|MAP_FIXED,-1,0) = 0x0000004000005000 22525 mprotect(0x0000004001899000,4096,PROT_READ) = 0 22525 mprotect(0x0000004000003000,4096,PROT_READ) = 0 22525 ioctl(1,TIOCGWINSZ,0x00000040018052b8) = 0 ({55,236,0,0}) isEven(1025): 0 22525 writev(1,0x4001805250,0x2) = 16 22525 exit_group(0)
But we can do even more. For example, we can learn how a CPU would hypothetically break a program down into translation buffers full of micro-ops (these are TCG micro-ops but real CPUs are similar enough to gain a general understanding of the concept):
$ qemu-x86_64 -d op ./example OP: ld_i32 tmp11,env,$0xfffffffffffffff0 brcond_i32 tmp11,$0x0,lt,$L0
---- 000000400185eafb 0000000000000000 discard cc_dst discard cc_src discard cc_src2 discard cc_op mov_i64 tmp0,$0x0 mov_i64 rbp,tmp0
---- 000000400185eafe 0000000000000031 mov_i64 tmp0,rsp mov_i64 rdi,tmp0
---- 000000400185eb01 0000000000000031 mov_i64 tmp2,$0x4001899dc0 mov_i64 rsi,tmp2
---- 000000400185eb08 0000000000000031 mov_i64 tmp1,$0xfffffffffffffff0 mov_i64 tmp0,rsp and_i64 tmp0,tmp0,tmp1 mov_i64 rsp,tmp0 mov_i64 cc_dst,tmp0
---- 000000400185eb0c 0000000000000019 mov_i64 tmp0,$0x400185eb11 sub_i64 tmp2,rsp,$0x8 qemu_st_i64 tmp0,tmp2,leq,0 mov_i64 rsp,tmp2 mov_i32 cc_op,$0x19 goto_tb $0x0 mov_i64 tmp3,$0x400185eb11 st_i64 tmp3,env,$0x80 exit_tb $0x7f72ebafc040 set_label $L0 exit_tb $0x7f72ebafc043
...If you want to trace the actual CPU registers for every instruction executed, that's possible too:
$ qemu-x86_64 -d cpu ./example RAX=0000000000000000 RBX=0000000000000000 RCX=0000000000000000 RDX=0000000000000000 RSI=0000000000000000 RDI=0000000000000000 RBP=0000000000000000 RSP=0000004001805690 R8 =0000000000000000 R9 =0000000000000000 R10=0000000000000000 R11=0000000000000000 R12=0000000000000000 R13=0000000000000000 R14=0000000000000000 R15=0000000000000000 RIP=000000400185eafb RFL=00000202 [-------] CPL=3 II=0 A20=1 SMM=0 HLT=0 ES =0000 0000000000000000 00000000 00000000 CS =0033 0000000000000000 ffffffff 00effb00 DPL=3 CS64 [-RA] SS =002b 0000000000000000 ffffffff 00cff300 DPL=3 DS [-WA] DS =0000 0000000000000000 00000000 00000000 FS =0000 0000000000000000 00000000 00000000 GS =0000 0000000000000000 00000000 00000000 LDT=0000 0000000000000000 0000ffff 00008200 DPL=0 LDT TR =0000 0000000000000000 0000ffff 00008b00 DPL=0 TSS64-busy GDT= 000000400189f000 0000007f IDT= 000000400189e000 000001ff CR0=80010001 CR2=0000000000000000 CR3=0000000000000000 CR4=00000220 DR0=0000000000000000 DR1=0000000000000000 DR2=0000000000000000 DR3=0000000000000000 DR6=00000000ffff0ff0 DR7=0000000000000400 CCS=0000000000000000 CCD=0000000000000000 CCO=EFLAGS EFER=0000000000000500
...You can also trace with disassembly for each translation buffer generated:
$ qemu-x86_64 -d in_asm ./example
IN: 0x000000400185eafb: xor %rbp,%rbp 0x000000400185eafe: mov %rsp,%rdi 0x000000400185eb01: lea 0x3b2b8(%rip),%rsi # 0x4001899dc0 0x000000400185eb08: and $0xfffffffffffffff0,%rsp 0x000000400185eb0c: callq 0x400185eb11
IN: 0x000000400185eb11: sub $0x190,%rsp 0x000000400185eb18: mov (%rdi),%eax 0x000000400185eb1a: mov %rdi,%r8 0x000000400185eb1d: inc %eax 0x000000400185eb1f: cltq 0x000000400185eb21: mov 0x8(%r8,%rax,8),%rcx 0x000000400185eb26: mov %rax,%rdx 0x000000400185eb29: inc %rax 0x000000400185eb2c: test %rcx,%rcx 0x000000400185eb2f: jne 0x400185eb21
...All of these options, and more, can also be stacked. For more ideas, look at qemu-x86_64 -d help. Now, lets talk about using this with gdb using qemu-user's gdbserver functionality, which allows for gdb to control a remote machine.
To start a program under gdbserver mode, we use the -g argument with a port number. For example, qemu-x86_64 -g 1234 ./example will start our example program with a gdbserver listening on port 1234. We can then connect to that gdbserver with gdb:
$ gdb ./example
...Reading symbols from ./example... (gdb) target remote localhost:1234 Remote debugging using localhost:1234 0x000000400185eafb in ?? () (gdb) br isEven Breakpoint 1 at 0x4000001233: file example.c, line 12. (gdb) c Continuing.
Breakpoint 1, isEven (x=1025) at example.c:12 12 return x == 0 || isOdd(x - 1); (gdb) bt full #0 isEven (x=1025) at example.c:12 No locals. #1 0x0000004000001269 in main () at example.c:16 No locals.
All of this is happening without any knowledge or cooperation of the program. As far as its concerned, its running as normal, there is no ptrace or any other weirdness.
However, this is not 100% perfect: a program could be clever and run the cpuid instruction and check for GenuineIntel or AuthenticAMD and crash out if it doesn't see that it is running on a legitimate CPU. Thankfully, qemu-user has the ability to spoof CPUs with the -cpu option.
If you find yourself needing to spoof the CPU, you'll probably have the best results with a simple CPU type like -cpu Opteron_G1-v1 or similar. That CPU type spoofs an Opteron 240 processor, which was one of the first x86_64 CPUs on the market. You can get a full list of CPUs supported by your copy of the qemu-user emulator by doing qemu-x86_64 -cpu help.
There's a lot more qemu-user emulation can do to help with reverse engineering, for some ideas, look at qemu-x86_64 -h or similar.