If it helps, i compiled the preloader with debug output. Here's the output:
U-Boot SPL 2013.01.01 (Jul 11 2016 - 10:46:04)
BOARD : Altera SOCFPGA Cyclone V Board
CLOCK: EOSC1 clock 20000 KHz
CLOCK: EOSC2 clock 20000 KHz
CLOCK: F2S_SDR_REF clock 0 KHz
CLOCK: F2S_PER_REF clock 0 KHz
CLOCK: MPU clock 600 MHz
CLOCK: DDR clock 300 MHz
CLOCK: UART clock 100000 KHz
CLOCK: MMC clock 5000 KHz
CLOCK: QSPI clock 2343 KHz
RESET: WARM
INFO : Watchdog enabled
SDRAM: Initializing MMR registers
Configuring CTRLCFG
Write - Address 0xffc25000 Data 0x000a8042
Read and verify...correct!
Configuring DRAMTIMING1
Write - Address 0xffc25004 Data 0x3138ce06
Read and verify...correct!
Configuring DRAMTIMING2
Write - Address 0xffc25008 Data 0x0aaaa925
Read and verify...correct!
Configuring DRAMTIMING3
Write - Address 0xffc2500c Data 0x00221eb3
Read and verify...correct!
Configuring DRAMTIMING4
Write - Address 0xffc25010 Data 0x00000e00
Read and verify...correct!
Configuring LOWPWRTIMING
Write - Address 0xffc25014 Data 0x00080000
Read and verify...correct!
Configuring DRAMADDRW
workaround rows - memsize 4294967296
workaround rows - cs 1
workaround rows - width 8
workaround rows - rows 14
workaround rows - banks 3
workaround rows - cols 10
rows workaround - term1 4294967296
rows workaround - term2 524288
rows workaround - bits 1
rows workaround - ilog2 19, 524288
Write - Address 0xffc2502c Data 0x00000e6a
Read and verify...correct!
Configuring DRAMIFWIDTH
Write - Address 0xffc25030 Data 0x00000010
Read and verify...correct!
Configuring DRAMDEVWIDTH
Write - Address 0xffc25034 Data 0x00000008
Read and verify...correct!
Configuring LOWPWREQ
Write - Address 0xffc25054 Data 0x00000030
Read and verify...correct!
Configuring DRAMINTR
Write - Address 0xffc2503c Data 0x00000000
Read and verify...correct!
Configuring STATICCFG
Write - Address 0xffc2505c Data 0x00000002
Read and verify...correct!
Configuring CTRLWIDTH
Write - Address 0xffc25060 Data 0x00000001
Read and verify...correct!
Configuring PORTCFG
Write - Address 0xffc2507c Data 0x0000003f
Read and verify...correct!
Configuring FIFOCFG
Write - Address 0xffc25088 Data 0x00000000
Read and verify...correct!
Configuring MPPRIORITY
Write - Address 0xffc250ac Data 0x3ffd1088
Read and verify...correct!
Configuring MPWEIGHT_MPWEIGHT_0
Write - Address 0xffc250b0 Data 0x21084210
Read and verify...correct!
Configuring MPWEIGHT_MPWEIGHT_1
Write - Address 0xffc250b4 Data 0x8081ef84
Read and verify...correct!
Configuring MPWEIGHT_MPWEIGHT_2
Write - Address 0xffc250b8 Data 0x00000000
Read and verify...correct!
Configuring MPWEIGHT_MPWEIGHT_3
Write - Address 0xffc250bc Data 0x0000f800
Read and verify...correct!
Configuring MPPACING_MPPACING_0
Write - Address 0xffc250c0 Data 0x20820820
Read and verify...correct!
Configuring MPPACING_MPPACING_1
Write - Address 0xffc250c4 Data 0x08208208
Read and verify...correct!
Configuring MPPACING_MPPACING_2
Write - Address 0xffc250c8 Data 0x41041041
Read and verify...correct!
Configuring MPPACING_MPPACING_3
Write - Address 0xffc250cc Data 0x00410410
Read and verify...correct!
Configuring MPTHRESHOLDRST_MPTHRESHOLDRST_0
Write - Address 0xffc250d0 Data 0x01010101
Read and verify...correct!
Configuring MPTHRESHOLDRST_MPTHRESHOLDRST_1
Write - Address 0xffc250d4 Data 0x01010101
Read and verify...correct!
Configuring MPTHRESHOLDRST_MPTHRESHOLDRST_2
Write - Address 0xffc250d8 Data 0x00000101
Read and verify...correct!
Configuring PHYCTRL_PHYCTRL_0
Write - Address 0xffc25150 Data 0x00000200
Read and verify...correct!
Configuring CPORTWIDTH
Write - Address 0xffc25064 Data 0x00044555
Read value without verify 0x00044fff
Configuring CPORTWMAP
Write - Address 0xffc25068 Data 0x2c011000
Read value without verify 0x2c03ffff
Configuring CPORTRMAP
Write - Address 0xffc2506c Data 0x00b00088
Read value without verify 0x00b3ffff
Configuring RFIFOCMAP
Write - Address 0xffc25070 Data 0x00760210
Read value without verify 0x0076ffff
Configuring WFIFOCMAP
Write - Address 0xffc25074 Data 0x00980543
Read value without verify 0x0098ffff
Configuring CPORTRDWR
Write - Address 0xffc25078 Data 0x0005a56a
Read value without verify 0x0005afff
Configuring DRAMODT
Write - Address 0xffc25018 Data 0x00000001
Read and verify...correct!
Configuring FPGAPORTRST
Configuring STATICCFG_
Write - Address 0xffc2505c Data 0x0000000a
Read value without verify 0x00000002
sdram_calculate_memory returns 268435456
sdram set rule start 0, 0
sdram set rule end fff, 0
sdram set rule start 0, 0
sdram set rule end fff, 0
sdram set rule start 0, 0
sdram set rule end fff, 0
sdram set rule start 0, 0
sdram set rule start 0, 0
sdram set rule end ff, 268435456
SDRAM Prot rule, default 3ff
Rule 0, rules ...
sdram start 0
sdram end fff00000
low prot id 0, hi prot id 0
portmask 0
security 0
result 0
valid 0
Rule 1, rules ...
sdram start 0
sdram end fff00000
low prot id 0, hi prot id 0
portmask 0
security 0
result 0
valid 0
Rule 2, rules ...
sdram start 0
sdram end fff00000
low prot id 0, hi prot id 0
portmask 0
security 0
result 0
valid 0
Rule 3, rules ...
sdram start 0
sdram end fff00000
low prot id 0, hi prot id 0
portmask 0
security 0
result 0
valid 0
Rule 4, rules ...
sdram start 0
sdram end fff00000
low prot id 0, hi prot id 0
portmask 0
security 0
result 0
valid 0
Rule 5, rules ...
sdram start 0
sdram end fff00000
low prot id 0, hi prot id 0
portmask 0
security 0
result 0
valid 0
Rule 6, rules ...
sdram start 0
sdram end fff00000
low prot id 0, hi prot id 0
portmask 0
security 0
result 0
valid 0
Rule 7, rules ...
sdram start 0
sdram end fff00000
low prot id 0, hi prot id 0
portmask 0
security 0
result 0
valid 0
Rule 8, rules ...
sdram start 0
sdram end fff00000
low prot id 0, hi prot id 0
portmask 0
security 0
result 0
valid 0
Rule 11, rules ...
sdram start 0
sdram end fff00000
low prot id 0, hi prot id 0
portmask 0
security 0
result 0
valid 0
Rule 14, rules ...
sdram start 0
sdram end fff00000
low prot id 0, hi prot id 0
portmask 0
security 0
result 0
valid 0
Rule 19, rules ...
sdram start 0
sdram end fff00000
low prot id 0, hi prot id 0
portmask 0
security 0
result 0
valid 0
SDRAM: Calibrating PHY
SEQ.C: Preparing to start memory calibration
SEQ.C: CALIBRATION PASSED
sdram_calculate_memory returns 268435456
SDRAM: 256 MiB
Setup interrupt controller... IRQ SP at 0x00000000 with size 0x00000400
boot device - 3
ALTERA DWMMC: 0
Buswidth = 1, clock: 0
Buswidth = 1, clock: 400000
altera_dwmci_clksel: drvsel 3 smplsel 0
altera_dwmci_clksel: SYSMGR_SDMMCGRP_CTRL_REG = 0x3
Sending CMD0
Sending CMD8
Sending CMD55
Sending CMD41
Sending CMD55
Sending CMD41
Sending CMD2
Sending CMD3
Sending CMD9
Sending CMD13
Sending CMD7
Sending CMD55
Sending CMD51
Sending CMD6
Sending CMD6
Sending CMD55
Sending CMD6
Buswidth = 4, clock: 400000
Buswidth = 4, clock: 5000000
altera_dwmci_clksel: drvsel 3 smplsel 0
altera_dwmci_clksel: SYSMGR_SDMMCGRP_CTRL_REG = 0x3
Sending CMD16
Sending CMD17
boot mode - FAT
Sending CMD16
Sending CMD17
Sending CMD16
Sending CMD17
reading u-boot.img
Sending CMD16
Sending CMD17
VFAT Support enabled
FAT16, fat_sect: 16, fatlength: 256
Rootdir begins at cluster: 0, sector: 528, offset: 42000
Data begins at: 528
Sector size: 512, cluster size: 16
FAT read sect=528, clust_size=16, DIRENTSPERBLOCK=16
Sending CMD16
Sending CMD18
Sending CMD12
Rootvfatname: |zimage|
RootMismatch: |zimage|zimage|
RootMismatch: |zimage||
Rootvfatname: |u-boot.scr|
RootMismatch: |u-boot.scr|u-boot.scr|
RootMismatch: |u-boot.scr||
Rootvfatname: |socfpga.dtb|
RootMismatch: |socfpga.dtb|socfpga.dtb|
RootMismatch: |socfpga.dtb||
Rootvfatname: |system volume information|
RootMismatch: |system~1|system volume information|
RootMismatch: |system~1||
Rootvfatname: |u-boot.img|
RootName: u-boot.img, start: 0x527, size: 0x3f110
Filesize: 258320 bytes
64 bytes
gc - clustnum: 1319, startsect: 21632
Sending CMD16
Sending CMD17
Size: 258320, got: 64
spl: payload image: U-Boot 2013.01.01 for socfpga bo▒▒neu|I▒>▒▒▒▒z▒▒.{▒▒▒▒|▒U;▒/&▒_▒▒P▒▒▒▒▒u▒▒▒▒$▒▒▒w▒ng~▒▒W▒
Any ideas where the garbage at the bottom is coming from (It's much longer but i had to short it to fit this message, complete file is attached)? I don't get this without the debug flag set, I'm still digging...