It’s true that one of the most efficient ways to build wealth over time is through investing. But are you making mistakes that are eroding your wealth?

There are a few things you might be doing, as an investor, that are reducing your real returns. Here are 5 of the common investing mistakes you should avoid if you want to see better returns over time:

1. Paying High Fees

You might be surprised at how much high fees are costing you. Here in the United States, there are studies that indicate you could be losing hundreds of thousands of dollars over your lifetime due to unnecessarily high fees — and the opportunity cost associated with those fees. Not only do you have less capital invest when you pay high fees, but you also miss out on the money that you could have earned on that amount.

While fees are a reality associated with investing, you don’t have to pay fees that are too high. Instead, look for fees investments that are low-cost. There are index funds and ETFs with low expense ratios. Brokerages are becoming increasingly competitive about offering lower transaction fees. Shop around for your investments, just as you would for other items.

2. Frequent Trading

Another mistake is too-frequent trading. Most “ordinary” investors do best when they take a long-term approach to investing by choosing some high-quality investments and sticking with them. While some re-balancing is needed to maintain a certain asset allocation, trading shouldn’t happen all that often.

One of the biggest ways frequent trading causes problems is due to the fees it incurs. The more you trade, the more you’ll pay in fees. On top of that, frequent trading often results in attempts to time the market. This rarely ends well for most people. You run a greater risk of buying high and selling low — the opposite of what you want to do.

3. Failure to Plan for Taxes

An inefficient tax plan for your investment accounts is another mistake that can erode your long-term returns. Different investments have different tax qualities. Some investments are inherently tax-efficient, so you don’t want to take up your contribution room in tax-advantaged accounts. Instead, you want to hold investments that are less efficient in tax-advantaged and registered accounts.

It also helps to plan ahead for tax consequences during retirement. We don’t have income splitting in the United States (since many couples choose to file jointly), but it is something to think about in Canada. Depending on your situation, income splitting can make sense, and you’ll need to consider that tax option as you think about taking money in retirement, or how you assign your income after selling investments for profit.

Think through the immediate and long-term tax consequences associated with your investments. It can make sense to consult with a professional who can help you figure out the best plan when it comes to making sure that you only pay what is required in taxes — and not a penny more.

4. Chasing High Yields

This mostly applies to dividend investing. In some cases, it’s tempting to build an income portfolio based on high-yield dividend stocks. However, it’s important to understand that sometimes a high yield isn’t always a sign of long-term stability. Additionally, you might be blinded by yield into investing in something that isn’t exactly “qualified” in terms of offering you the best tax deal.

Fundamentally evaluate your investment choices. While there is a place for high-yield dividend stocks in your portfolio, and they can serve your purposes as part of a well-thought-out plan, you need to make sure that they really are right for your needs. If all you do is look at the yield, and pay attention to nothing else, you could be in for a costly surprise down the road.

5. Not Starting Early

If you haven’t already started investing, now is the time to get started. The longer you invest, the better your chance of overcoming down markets, and earning more through the power of compound interest. You can start with a small amount and use dollar cost averaging to establish a consistent investment plan. Start now, and you’ll likely be in a better place later.