Fast casual restaurants typically have more insulation from a downturn because they target higher-income customers than traditional fast food. Rising unemployment and lower discretionary spending are forcing consumers into even more scrutiny over their spending these days and one area hit particularly hard is this category.