Thoughts on all-remote

Working in an all-remote company has always been an interesting thought exercise to me. Would it work for me? Would it work for the company? At what cost?