There is no evidence that they ascended. They were like Lazarus' resurrection - temporary, and they later died again. Jesus was the first one to be raised immortal, according to 1 Corinthians 15.

It says Jesus took captivity captive. If they were already resurrected, then Jesus would be releasing them from any kind of captivity at His ascension. The NT teaches that now that the veil has been torn, all believers go immediately to dwell in God's presence when they die. Also, this passage is referring to those imprisoned under the earth:

1 Peter 3:18-20 For Christ also hath once suffered for sins, the just for the unjust, that he might bring us to God, being put to death in the flesh, but quickened by the Spirit: By which also he went and preached unto the spirits in prison; Which sometime were disobedient, when once the longsuffering of God waited in the days of Noah, while the ark was a preparing, wherein few, that is, eight souls were saved by water.

The word for preached here means "public herald". When Jesus died, He went to Abraham's Bosom (where Abraham and Lazarus were, and where the thief was shortly going to come), and from there announced to those wicked that were suffering (such as the rich man, and all others that had perished since the creation of the world) that He had conquered and was victorious. Then He arose on the third day, ascended to His Father sometime later in that day (after speaking to Mary Magdalene, but before going to the locked room where His disciples were), then stayed with His disciples for 40 days and ascended to dwell in Heaven (Hebrews 9:24) - I believe this 2nd ascension was when He took those captive righteous souls to Heaven.

Again, those who were resurrected when Jesus died were not raised immortal - and Hebrews 12 clearly indicates that no resurrected souls are in Heaven:

Hebrews 12:22-24 But ye are come unto mount Sion, and unto the city of the living God, the heavenly Jerusalem, and to an innumerable company of angels, To the general assembly and church of the firstborn, which are written in heaven, and to God the Judge of all, and to the spirits of just men made perfect, And to Jesus the mediator of the new covenant, and to the blood of sprinkling, that speaketh better things than that of Abel.

In Heaven, we can see the church (ie. those who have died so far), and the SPIRITS of OT saints - not their bodies, they were not resurrected immortal yet.