Issue #1580348 by bojanz, hswong3i, roborn, itamar, vasike: Make the formatters work with other reference fields