It is recommended for the pilgrim to continue reciting the Talbiyah until he starts stoning Jamrat Al-'Aqabah on the day of sacrifice Sahih Muslim 1283 b, c

Arabic hadith text
وَحَدَّثَنَا سُرَيْجُ بْنُ يُونُسَ، حَدَّثَنَا هُشَيْمٌ، أَخْبَرَنَا حُصَيْنٌ، عَنْ كَثِيرِ بْنِ مُدْرِكٍ الأَشْجَعِيِّ، عَنْ عَبْدِ الرَّحْمَنِ بْنِ يَزِيدَ، أَنَّ عَبْدَ اللَّهِ، لَبَّى حِينَ أَفَاضَ مِنْ جَمْعٍ فَقِيلَ أَعْرَابِيٌّ هَذَا فَقَالَ عَبْدُ اللَّهِ أَنَسِيَ النَّاسُ أَمْ ضَلُّوا سَمِعْتُ الَّذِي أُنْزِلَتْ عَلَيْهِ سُورَةُ الْبَقَرَةِ يَقُولُ فِي هَذَا الْمَكَانِ ‏"‏لَبَّيْكَ اللَّهُمَّ لَبَّيْكَ ‏"‏ ‏. وَحَدَّثَنَاهُ حَسَنٌ الْحُلْوَانِيُّ، حَدَّثَنَا يَحْيَى بْنُ آدَمَ، حَدَّثَنَا سُفْيَانُ، عَنْ حُصَيْنٍ، بِهَذَا الإِسْنَادِ
Translation
'Abd al-Rahman b. Yazid reported that 'Abdullah (b. Mas'ud) pronounced Talbiya as he returned from the gathering of the people (at Muzdalifa). It was said

He might be a Bedouin (not knowing correctly the rituals of Hajj and, therefore, pronouncing Talbia at this stage), whereupon Abdullah said: Hive the people forgotten (this Sunnah of the Holy Prophet) or have they gone astray? I heard him, upon whom Sibrah al-Baqara was revealed, pronouncing Talbiya at the very place.