Swanston street, Elizabeth Street and also the China Town areas of Little Bourke street use the best budget restaurants and cafes inside of CBD area.
You can Google search to be able to various lists of these directories. https://twitter.com/kendradawning