Dear Martin!
If you want to bless the icons, just bring them next time to the church and ask your priest to bless them. He will read special prayers of blessing over them.
The best time for this is either before or after the general service. But your priest might have a different practice.
The service of blessingis not a long one, but very meaningful. The grace of the Holy Spirit is asked to be with the icons that were blessed so that people could use them during their prayer or devotional time.
God bless!