I would seriously debate the idea that a FWD Integra is faster round a B-road than a RWD Silvia.
I've driven mid-engine RWD MR2s NA and turbo in anger, and front-engine RWD Corvette in anger. I've had experiences of, but not ownership of fast FWD Leon Cupra and Type R FN2s on twisties too. The final experience was RR, in the form of 993 Targa S. I have to confess the last time I owned a FWD car I was 18.
It's hard to be categorical because the single biggest factor is the tyre in almost all scenarios for me, and it's not like each car had the same tyre nor wear, but I would confidently say RWD is faster than FWD and even more noticeably on twisties than on straights from all of my experiences. Demanding cornering grip as well as accelerative grip from the front tyres only is never going to be a match for separating the duties between the two axles. I genuinely don't think I could push a FWD car as quickly around a mountain road as I could a RWD car. For me, one of the biggest differences in the handling traits is that in a FWD car you get away with a lot more primitive throttle stabbing than you do in a RWD, where you'll provoke sometimes catastrophic loss of grip. It's all about linearity in a RWD car, with a reduced window for error. I suspect learning that lesson (note I'm not saying this to you, I'm saying it generally - no intention to offend) would improve FWD driving no end too.
Like you're saying though, I suppose it's strokes/folks. The main thing is you have a car you enjoy driving, and I like you cannot justify a part-time car, so mine has to be enjoyable all the time, all year. If yours is a DC5 then have at it. I would just preach a bit of learning time like the other guys here have - FWD just isn't as much fun!