Bridging the Gap between Protoplanetary and Debris Disks: Separate Evolution of Millimeter and Micrometer-sized Dust