Humankinds urbanization and luxurious need increase the number of vehicles day by day. Due to the resource constraints for obtaining a high processing rate in performing the intelligent tasks, Vehicular Edge Computing (VEC) has been introduced. However, a delay occurs in transferring the information due to the traits of automotive tasks. In this paper, a Federated Learning empowered computation Offloading and Resource management (FLOR) is proposed. The FLOR framework operates over heterogeneous networks that include Vehicle-to-Everything (V2X) communication, Dedicated Short Range Communication (DSRC), 5G millimeter-wave (5G-mmWave), and 6G Vehicle-to-Vehicle (6G-V2V) communication. FLOR employs the stochastic network calculus mechanism for computing the upper bound delay of the heterogeneous communication and obtains the probability of offloading mechanism. Upon the detected probability value, the FLOR offloads the computation task to the optimal network. Further, to avoid the increase in resource cost and utilize the available resources efficiently, an effective Radio Resource Management (e-RRM) based on Federated Q-Learning is proposed in FLOR, for allocating the available resources optimally. The simulation result shows that the proposed FLOR framework effectively offloads the computation between the available heterogeneous networks with optimal resource allocation by 20.69% than the existing solutions.