Isaiah 17

In Zenos's allegory of the tame and wild olive trees, as the Lord sent his servant for the last time -

"...the servant went and did as the Lord had commanded him, and brought other servants; and they were few."  (Book of Mormon | Jacob 5:70)

I believe this is what Isaiah saw that -

"...in that day it shall come to pass, that the glory of Jacob shall be made thin, and the fatness of his flesh shall wax lean."  (Old Testament | Isaiah 17:4)

That is that when the wicked are destroyed and only the righteous remain, there will be few left just as -

"...gleaning grapes shall be left in it, as the shaking of an olive tree, two or three berries in the top of the uppermost bough, four or five in the outmost fruitful branches thereof, saith the LORD God of Israel."  (Old Testament | Isaiah 17:6)

And at the time these righteous servants remain -

"...shall a man look to his Maker, and his eyes shall have respect to the Holy One of Israel.
8 And he shall not look to the altars, the work of his hands, neither shall respect that which his fingers have made, either the groves, or the images."  (Old Testament | Isaiah 17:7 - 8)