Canto 1 - Boyhood
Bāla-kāṇḍa
Chapter 31: Viśvāmitra, Rāma and Lakṣmaṇa Depart for Mithilā
Text 1.31.19

निवर्तयामास ततः पक्षिसङ्घान्मृगानपि॥

nivartayām āsa tataḥ pakṣi-saṅghān mṛgān api

nivartayām āsa = the sage prevented; tataḥ = then; pakṣi-saṅghān = the birds; mṛgān = and deer; api from following him.

The sage then prevented the birds and deer from following him.1

Since it is stated here that the sage prevented [only] the birds and deer from following him, it is indicated that the sages continued to follow him.

1 He sent all the birds and deer back to Siddhāśrama.