Classification of crystalline topological insulators and superconductors with point group symmetries