This problem occurs on the BBB when calling dma_request_channel(). I am using this driver https://github.com/fpga-logi/logi-kernel. When doing a write operation on /dev/logibone_mem, the system hangs (kernel crash?).
The same driver works on 4.1.x-bone-rt and 4.8.x-bone-rt without issues.