Don't discount the possibility that trout have inspected, taken & rejected your wet fly on its dead drift downstream. It takes experience, skill and sometimes a bit of luck to detect strikes on wets/nymphs fished upstream.

A wet fly that is slowly swung "down and across" is a fun way to pick up some aggressive feeders, particularly when there is sedge activity. Cast across and slightly upstream from you, allow the fly to sink and dead drift several yards, then mend as necessary to slow its swing below you. Takes can happen anywhere along the swing. If no takes at the end of the swing, allow the fly to dangle momentarily, try a slow twitch retrieve for 12-18", then allow the fly to drift back and dangle again before picking up and casting again.

If you want a better chance at the better trout in your stream, you need to present your fly over better holding water. Wide, shallow runs over sandy and small cobble bottom is more suited to the smaller fish you've been catching. The larger trout have taken residence where overhead cover, bottom structure, and water depth/speed are favorable. Study your stream for seams, variations in flow, feeding lanes, foam lines, undercut banks, submerged rocks, etc. In an otherwise featureless stream bottom, even something as simple as a shallow depression in the cobble might be the choice lie.