PVE in EVE is any combat situation situation where you are fighting NPCs (As opposed to PVP where you are fighting players)

Examples include Mission Running, ratting, incursions, exploration, anomalies, and fighting Sleepers in wormholes. Clearing rats from Belts, Gas Clouds, Radar sites and Magnometric Sites can also be considered PVE.

In most stations you can find agents (They have their own tab in the station interface). If you have a sufficient standing with the agent or their corporation you can initiate a conversation with them and they will give you a mission. There are several types of missions (Kill missions, Courrier missons, Trade missions and Mining missions)

Mission running is mostly done in high sec to avoid the interference from PVP which is possible in low/null sec, (NOTE: if you are in Dreddit we are currently in a state of perpetual war, Hi-Sec won't save you.

More information on Mission Running can be found here.

This is going into asteroid belts or combat sites and killing the NPC pirate ships (rats) in them. You then get bounties, loot and salvage from them. Far quicker than missions. Only worthwhile in low/null sec. The lower the security status of the solar system, the bigger bounties appear.

Recommended ship: Cruiser/Battlecruiser/Battleship. Each have their own pros and cons.

More information on Ratting can be found here.