VM: fix pageout throttling to external pagers

Since the VM system has been tracking whether pages belong to internal
or external objects, pageout throttling to external pagers has simply
not been working. The reason is that, on pageout, requests for external
pages are correctly tracked, but on page release (which is used to
acknowledge the request), external pages are not marked external
any more. This is because the external bit tracks whether a page
belongs to an external object, and all pages, including external
ones, are moved to an internal object during pageout.

To solve this issue, a new "external_laundry" bit is added. It has
the same purpose as the laundry bit, but for external pagers.

* vm/vm_page.c (vm_page_seg_min_page_available): Function unused, remove.
(vm_page_seg_evict): Use vm_page_external_laundry_count instead of
vm_page_external_pagedout. Add an assertion about double paging.
(vm_page_check_usable): Use vm_page_external_laundry_count instead of
vm_page_external_pagedout.
(vm_page_evict): Likewise.
* vm/vm_page.h (struct vm_page): New `external_laundry' member.
(vm_page_external_pagedout): Rename to ...
(vm_page_external_laundry_count): ... this.
* vm/vm_pageout.c: Include kern/printf.h.
(DEBUG): New macro.
(VM_PAGEOUT_TIMEOUT): Likewise.
(vm_pageout_setup): Use vm_page_external_laundry_count instead of
vm_page_external_pagedout. Set `external_laundry' where appropriate.
(vm_pageout): Use VM_PAGEOUT_TIMEOUT with thread_set_timeout.
Add debugging code, commented out by default.
* vm/vm_resident.c (vm_page_external_pagedout): Rename to ...
(vm_page_external_laundry_count): ... this.
(vm_page_init_template): Set `external_laundry' member to FALSE.
(vm_page_release): Rename external parameter to external_laundry.
Slightly change pageout resuming.
(vm_page_free): Rename external variable to external_laundry.

1 files changed, 12 insertions, 11 deletions

diff --git a/vm/vm_resident.c b/vm/vm_resident.c
index e3e34dc3..b5096e00 100644
--- a/vm/vm_resident.c
+++ b/vm/vm_resident.c
@@ -140,7 +140,7 @@ int	vm_page_wire_count;
  *	pageout daemon.
  */
 int	vm_page_laundry_count = 0;
-int	vm_page_external_pagedout = 0;
+int	vm_page_external_laundry_count = 0;
 
 
 /*
@@ -611,6 +611,7 @@ static void vm_page_init_template(vm_page_t m)
 	m->inactive = FALSE;
 	m->active = FALSE;
 	m->laundry = FALSE;
+	m->external_laundry = FALSE;
 	m->free = FALSE;
 	m->external = FALSE;
 
@@ -811,7 +812,7 @@ phys_addr_t vm_page_grab_phys_addr(void)
 void vm_page_release(
 	vm_page_t	mem,
 	boolean_t 	laundry,
-	boolean_t 	external)
+	boolean_t 	external_laundry)
 {
 	simple_lock(&vm_page_queue_free_lock);
 	if (mem->free)
@@ -825,20 +826,20 @@ void vm_page_release(
 			vm_pageout_resume();
 		}
 	}
-	if (external) {
+	if (external_laundry) {
 
 		/*
-		 *	If vm_page_external_pagedout is negative,
+		 *	If vm_page_external_laundry_count is negative,
 		 *	the pageout daemon isn't expecting to be
 		 *	notified.
 		 */
 
-		if (vm_page_external_pagedout > 0) {
-			vm_page_external_pagedout--;
-		}
+		if (vm_page_external_laundry_count > 0) {
+			vm_page_external_laundry_count--;
 
-		if (vm_page_external_pagedout == 0) {
-			vm_pageout_resume();
+			if (vm_page_external_laundry_count == 0) {
+				vm_pageout_resume();
+			}
 		}
 	}
 
@@ -977,9 +978,9 @@ void vm_page_free(
 		vm_page_release_fictitious(mem);
 	} else {
 		boolean_t laundry = mem->laundry;
-		boolean_t external = mem->external;
+		boolean_t external_laundry = mem->external_laundry;
 		vm_page_init(mem);
-		vm_page_release(mem, laundry, external);
+		vm_page_release(mem, laundry, external_laundry);
 	}
 }