Joseph Smith shares of his visits with the angel Moroni - 

"I made an attempt to take them out, but was forbidden by the messenger, and was again informed that the time for bringing them forth had not yet arrived, neither would it, until four years from that time; but he told me that I should come to that place precisely in one year from that time, and that he would there meet with me, and that I should continue to do so until the time should come for obtaining the plates.

54 Accordingly, as I had been commanded, I went at the end of each year, and at each time I found the same messenger there, and received instruction and intelligence from him at each of our interviews, respecting what the Lord was going to do, and how and in what manner his kingdom was to be conducted in the last days."  Joseph Smith—History 1:53-54

In Lucy Smith's writings, she shared one of those visits - 

“On the twenty-second of September, 1824, Joseph again visited the place where he found the plates the year previous; and supposing at this time that the only thing required, in order to possess them until the time for their translation, was to be able to keep the commandments of God—and he firmly believed he could keep every commandment which had been given him—he fully expected to carry them home with him. Therefore, having arrived at the place, and uncovering the plates, he put forth his hand and took them up, but, as he was taking them hence, the unhappy thought darted through his mind that probably there was something else in the box besides the plates, which would be of some pecuniary [monetary] advantage to him. So, in the moment of excitement, he laid them down very carefully, for the purpose of covering the box, lest some one might happen to pass that way and get whatever there might be remaining in it. After covering it, he turned round to take the Record again, but behold it was gone, and where, he knew not, neither did he know the means by which it had been taken from him. “At this, as a natural consequence, he was much alarmed. He kneeled down and asked the Lord why the Record had been taken from him; upon which the angel of the Lord appeared to him, and told him that he had not done as he had been commanded, for in a former revelation he had been commanded not to lay the plates down, or put them for a moment out of his hands, until he got into the house and deposited them in a chest or trunk, having a good lock and key, and, contrary to this, he had laid them down with the view of securing some fancied or imaginary treasure that remained. “In the moment of excitement, Joseph was overcome by the powers of darkness, and forgot the injunction that was laid upon him. “Having some further conversation with the angel, on this occasion, Joseph was permitted to raise the stone again, when he beheld the plates as he had done before. He immediately reached forth his hand to take them, but instead of getting them, as he anticipated, he was hurled back upon the ground with great violence. When he recovered, the angel was gone, and he arose and returned to the house, weeping for grief and disappointment. “As he was aware that we would expect him to bring the plates home with him, he was greatly troubled, fearing that we might doubt his having seen them. As soon as he entered the house, my husband asked if he had obtained the plates. The answer was, ‘No, father, I could not get them.’ “His father then said, ‘Did you see them?’ “ ‘Yes,’ replied Joseph, ‘I saw them, but could not take them.’ ” (History of Joseph Smith by His Mother, Lucy Mack Smith, pp. 83–85).