CF cards are some of the most robust and durable memory cards available.
So even if you have a fairly high quality SD card in it, if the adapter causes issues while you are in the field shooting you will have no way to get your images recorded to the SD card. The biggest issue with using an SD to CF card adapter is that most of them aren't that reliable.