Bank-Held Loans · Flexible Guidelines · Non-Conforming
Portfolio Loans: How Bank-Held Mortgages Work and When They Are Your Best Option
A portfolio loan is a mortgage that the lender keeps on its own books instead of selling to Fannie Mae, Freddie Mac, or Ginnie Mae. Because the lender retains the risk, they can set their own guidelines — which means approving borrowers and properties that do not fit conventional or government loan programs.
Next step:
Compare Mortgage Offers
How They Work
- Bank-held: The lender originates the loan and keeps it in their investment portfolio instead of selling it on the secondary market
- Custom guidelines: Because the loan is not sold, it does not need to meet Fannie Mae, Freddie Mac, FHA, or VA requirements
- Relationship-based: Portfolio lenders often prioritize existing banking relationships — deposits, business accounts, and investment balances
- Action: Ask your bank or credit union directly if they offer portfolio mortgage products — they are not advertised widely
When to Use Them
- Non-warrantable condos: Properties that fail Fannie/Freddie warrantability requirements can often be financed through portfolio
- Unusual income: Borrowers with complex self-employment income, trust income, or asset-based income that AUS cannot evaluate
- Recent credit events: Borrowers within waiting periods for bankruptcy or foreclosure who have strong compensating factors
- Action: If conventional and government programs have denied you, ask a portfolio lender to review your file before giving up
Typical Terms
- Rates: 0.25% to 1.0% higher than comparable conforming loans — the premium reflects the lender’s retained risk
- Down payment: 10% to 30% depending on the lender and the risk profile of the loan
- Term: 15-year, 20-year, and 30-year fixed options available, plus ARMs — terms vary significantly by lender
- Action: Compare portfolio loan terms from at least 2 to 3 banks and credit unions — pricing varies widely on these products
Who Offers Them
- Community banks: Local and regional banks are the most common portfolio lenders — they use deposits to fund the loans
- Credit unions: Many credit unions keep loans in portfolio, especially for members with strong deposit relationships
- Private banks: Wealth management divisions of larger banks offer portfolio mortgages to high-net-worth clients
- Action: Start with banks where you have existing accounts — the relationship often matters for portfolio lending decisions
Frequently Asked Questions
Are portfolio loans harder to get than conventional?
Can a portfolio loan be sold later?
Do portfolio loans have PMI?
The Bottom Line Up Front
Portfolio loans are the mortgage market’s safety valve. When your income is too complex for AUS, your property does not meet agency guidelines, or your credit event is too recent for standard waiting periods, a portfolio lender can often say yes when everyone else says no. The cost is a modestly higher rate and typically a larger down payment.
The mortgage market is dominated by conforming loans — mortgages that meet Fannie Mae and Freddie Mac guidelines and are sold on the secondary market. Approximately 70% of all mortgages are conforming. The remaining 30% include FHA, VA, jumbo, and portfolio loans. Portfolio loans fill the gaps that no standardized program covers: unique property types, non-standard income documentation, mixed-use properties, land purchases, and borrowers with strong assets but unconventional income streams. The lender keeps the risk, which means the lender makes the rules.
- Portfolio lenders originate and hold the loan on their own balance sheet — they are not bound by Fannie Mae, Freddie Mac, FHA, or VA guidelines
- Approval decisions are often made by a human loan committee rather than automated underwriting — this allows for nuanced evaluation of complex borrower profiles
- Rates are typically 0.25% to 1.0% higher than comparable conforming products because the lender retains the default risk
- Down payment requirements are generally 10% to 30% — higher than conforming minimums because the lender has more skin in the game
How Are Portfolio Loans Different from Conventional Mortgages?
The fundamental difference is who bears the risk. Conventional loans are sold to Fannie Mae or Freddie Mac, which means the originating lender follows their guidelines. Portfolio loans are kept by the lender, which means the lender can create their own approval criteria.
- Conventional loans must pass DU or LP automated underwriting — portfolio loans are evaluated by human underwriters using the bank’s own risk criteria
- Conventional loans have standardized credit, income, and property requirements — portfolio requirements vary by lender and can be negotiated on complex files
- Conventional loans are standardized and liquid — they trade on the secondary market. Portfolio loans are illiquid — the lender holds them to maturity or sells them individually
- Conventional loan pricing follows Fannie/Freddie LLPA matrices — portfolio pricing is set by the individual lender based on their cost of funds and risk assessment
Who Benefits Most from Portfolio Loans?
Borrowers who fall outside the conforming box but have compensating strengths — typically strong assets, significant down payment, or an established banking relationship with the portfolio lender.
- Self-employed borrowers with complex income: business owners with strong cash flow but low taxable income due to deductions and depreciation — portfolio lenders can evaluate bank statements or asset statements instead of tax returns
- Foreign nationals: non-US citizens without US credit history or Social Security numbers — portfolio lenders can accept foreign credit reports and alternative documentation
- Non-warrantable condo buyers: condos that fail Fannie/Freddie warrantability (investor concentration, litigation, commercial space) can often be financed through portfolio
- Recently recovered borrowers: borrowers within standard waiting periods after bankruptcy or foreclosure who have re-established credit and can demonstrate the event was isolated
- Unique properties: mixed-use, non-standard construction, rural acreage, or properties with deferred maintenance that fail agency appraisal requirements
- High-net-worth borrowers: clients with significant liquid assets but irregular income — portfolio lenders can qualify on assets alone (asset depletion)
Lender Reality Check
Portfolio lending is a relationship business. The best portfolio terms go to borrowers who have existing deposit, investment, or business relationships with the bank. If you are approaching a portfolio lender for the first time, be prepared to bring some of your banking business — deposits, checking, or investment accounts — as part of the lending conversation. The bank is more likely to take risk on a client who brings additional business to the institution.
What Are the Trade-Offs of Portfolio Loans?
Higher rates, larger down payments, and limited availability. Portfolio loans cost more than conforming products because the lender retains the risk and cannot spread it across the secondary market.
- Rate premium: 0.25% to 1.0% above comparable conforming rates — on a $500,000 loan, a 0.50% premium adds approximately $145 per month or $52,000 over 30 years
- Down payment: 10% to 30% required versus 3% to 5% on conforming — the lender wants the borrower to have significant equity as a default buffer
- Prepayment penalties: some portfolio loans carry prepayment penalties that conforming loans are prohibited from having under QM rules — read your loan terms carefully
- Limited availability: not every bank offers portfolio mortgages, and those that do may only lend in certain markets or property types — availability varies significantly by institution
- Less standardization: terms, fees, and processes vary widely between portfolio lenders — there is no standard rate sheet or LLPA matrix to compare against
The Bottom Line
Portfolio loans are the answer when standardized programs say no but the deal makes sense. They cost more, require more down payment, and are harder to find — but they approve borrowers and properties that no agency program will touch. If you have been denied by conventional, FHA, and VA lenders, a portfolio lender at a community bank or credit union may be the path to approval.
Start by calling community banks and credit unions where you have existing accounts. Ask specifically about portfolio mortgage products. Bring your complete financial picture — tax returns, bank statements, asset statements, and a clear explanation of why conforming programs did not work. The loan officer at a portfolio lender has the flexibility to evaluate your file holistically rather than checking boxes on an automated system.
Frequently Asked Questions
Is a portfolio loan the same as a non-QM loan?
They overlap but are not identical. Non-QM loans are defined by their deviation from the Qualified Mortgage rule (ability-to-repay standards). Portfolio loans are defined by how the lender retains them. A portfolio loan can be QM-compliant or non-QM depending on its terms. Many non-QM loans are held in portfolio, but not all portfolio loans are non-QM.
Can I refinance a portfolio loan into a conventional mortgage later?
Yes. Once your circumstances change — improved credit score, longer employment history, property meeting agency standards — you can refinance into a conventional or government loan at a lower rate. Many borrowers use portfolio loans as a bridge to conventional financing.
Do portfolio loans show up on your credit report?
Yes. Portfolio loans are reported to the credit bureaus the same as any other mortgage. Timely payments build your credit history, and late payments are reported identically to conforming loan delinquencies.
What is the maximum loan amount for a portfolio loan?
There is no standardized limit. Each portfolio lender sets their own maximum based on their risk appetite and balance sheet capacity. Some community banks cap at $1 million, while private bank divisions of larger institutions may lend $5 million or more. The limit depends on the lender and the borrower’s profile.
Can you get a portfolio loan for an investment property?
Yes. Many portfolio lenders finance investment properties with terms that are more flexible than agency guidelines. Some community banks and credit unions offer portfolio investor loans with 20% to 25% down based on rental income and the borrower’s overall financial profile.
Do portfolio lenders require reserves?
Most do, and often more than conforming programs require. Portfolio lenders commonly require 6 to 12 months of PITI in liquid reserves because the larger down payment and reserves together reduce the lender’s default risk. The specific requirement varies by lender and loan profile.
How long does a portfolio loan take to close?
Portfolio loans can close faster than conforming loans because the lender is making the decision internally rather than following agency timelines. Closings in 15 to 25 days are common for straightforward files. Complex files with unusual income or property situations may take 30 to 45 days.
Are portfolio loan rates fixed or adjustable?
Both. Many portfolio lenders offer 30-year fixed, 15-year fixed, and various ARM products (5/1, 7/1, 10/1). Some prefer ARMs because adjustable rates reduce the lender’s interest rate risk on loans they hold. The best term and rate depend on the specific lender’s product menu.